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WELCOMING  REMARKS 


DR.  GENE  G.  MANNELLA 

Dean  of  the  School  of  Engineering  and  Architecture 
The  Catholic  University  of  America 

It  is  a  gratifying  task  for  me  to  extend  to  you  on  behalf  of  the  Catholic 
University  of  America  an  official  welcome  to  our  campus.  It  is  a  pleasure 
for  us  to  host  the  1972  Symposium  on  the  Applications  of  Walsh  Functions, 
and  we  join  with  our  co-sponsors,  the  Naval  Research  Laboratory  and  the 
Electromagnetic  Compatibility  Group  of  the  IEEE,  in  wishing  you  a  suc¬ 
cessful  meeting. 

The  program  for  this  year  continues  the  strong  international  flavor  that 
has  come  to  be  a  hallmark  of  this  symposium.  A  total  of  64  papers  from 
1 1  countries  will  be  presented  in  the  next  three  days,  giving  this  meeting 
the  broadest  representation  it  has  had  to  date.  To  our  colleagues  who  have 
journeyed  here  from  other  countries  we  extend  a  special  welcome  and  the 
hope  that  your  visit  will  be  most  productive. 

Based  on  the  pre-registration  and  the  pattern  of  symposium  attendance 
established  in  the  past  several  years,  we  anticipate  a  total  exceeding  200 
persons  v/ill  attend  this  symposium.  In  keeping  with  the  practice  of  the 
previous  Walsh  Functions  symposia,  the  proceedings  will  again  be  published 
and  distributed  at  a  nominal  charge  through  the  National  Technical  Infor¬ 
mation  Service,  although  all  registrants  will  receive  a  free  copy  as  soon  as 
they  are  available.  This  will  enable  the  broadest  distribution  of  the  material 
presented  here,  so  that  our  colleagues  throughout  the  profession  can  avail 
themselves  of  advances  in  the  applications  of  Walsh  Functions  as  reported 
here. 

It  is  clear  from  the  statement  of  the  Symposium  objectives  published 
in  this  year’s  program  that. especial  interest  will  again  be  placed  on  the  ap¬ 
plication  of  Walsh  and  other  nonsinusoidal  functions.  This  is  certainly  in 
keeping  with  the  mood  of  today’s  society  which  is  oriented  toward  the  use 
of  the  gnat  store  of  knowledge  built  up  in  the  past  several  decades  in 
finding  the  solution  to  many  problems  which  cause  us  concern.  This  is  not 
in  any  way  to  diminish  the  need  for,  or  importance  of,  increasing  the  body 
of  knowledge  in  a  given  Field,  but  only  to  illustrate  that  our  first  duty  as 
engineers  and  scientists  lies  in  explicitly  applying  our  capability  to  the  ulti¬ 
mate  benefit  of  society. 

There  is  something  particularly  gratifying  in  successfully  applying  the 
abstract  to  specific  problems.  Perhaps  in  the  next  three  days  we  will  see 
several  exciting  examples  of  this.  To  that  end  I  wish  you  welFin  your 
symposium  and  hope  that  it  will  be  as  productive  as  those  that  have  preceded 
it. 


APPLICATIONS 

OF 

WALSH  FUNCTIONS 


SYMPOSIUM 
27,28,29  MARCH 


THE  WONDERFUL  WORLD  OF  WALSH  FUNCTIONS  * 


Robert  B.  Lackey 

Electrical  Engineering  Department 

The  Ohio  State  University 
Columbus,  Ohio  43210 


As  I  pondered  the  submission  of  an  abstract  any  two  functions  together  and  integrate  over 

for  this  paper,  the  first  title  that  occured  to  the  Interval  (add  up  the  values)  the  answer  is 

me  was  "Everything  you  always  wanted  to  know....  zero,  unless  the  two  functions  are  the  same 

etc,"  Aside  from  the  face  that  everyone  is  using  function,  formalized  means  that  if  the  two 

that  title  these  days,  I  am  a  person  who  likes  to  functions  are  one  and  the  same,  the  integral  of 

come  to  the  point.  X  chose  instead,  "The  Wonder-  their  product  is  unity.  Complete  is  a  nice 

ful  World  of  Walsh  Functions."  I  will  now  pro-  property,  not  worth  discussing  further  here, 

ceed  to  answer  my  own  question  in  as  painless  a 

way  as  1  can.  As  luck  would  have  it,  the  best  way  to  de¬ 

fine  the  Walsh  functions  is  in  terms  of  another 


The  original  paper,  by  J.L.  Walsh,  perhaps 
surprisingly,  is  not  recent;  it  appeared  in 
print  in  1923.  As  is  often  the  case,  with  a  few 
notable  exceptions,  not  much  was  done  with  these 
functions,  or  to  them,  or  about  them  until  1968. 
It  was  then  that  Dr.  H.F.  Harmuth's  article 
appeared  in  the  Spectrum  of  the  IEEE,  and  in¬ 
spired  a  tremendous  amount  of  work  in  the  area. 

It  was  also  at  this  time  that  mv  own  personal 
intimacy  with  Walsh  functions  began.  The  second 
thing  I  did  after  reading  the  article  was  to 
order  a  copy  of  Dr.  Harmuth's  book.[l]  I  rea¬ 
soned  that  if  the  article  were  good,  the  book 
should  be  even  better,  and  I  wrs  right.  (Not 
always  true  when  they  make  a  movie  from  a  book.) 

I  have  been  using  the  book  as  a  text  for  a  course 
in  signal  processing  with  a  digital  computer. 

It  was  during  the  time  that  I  was  waiting  for 
the  book  to  arrive  that  I  began  the  self-educa¬ 
tion  process  which  I  have  found  ever  so  valuable 
to  an  ultimate  understanding.  It  is  of  course 
mv  hope  that  this  paper  will  similarly  motivate 
at  least  one  person  to  explore  the  area  of  Walsh 
functions  more  deeply. 

Before  I  tell  you  now  to  generate  the  happy 


set  of  functions  called  Rademacher  functions. 
(This  is  my  own  personal  favorite  definition; 
others  are  equally  valid).  I  will  define 
Rademacher  functions  first.  The  first  step  in 
defining  these  fjnctions  is  to  take  the  unit 
Interval  and  imagine  it  divided  up  into  2n  sub- 
intervals.  Did  you  do  it?  Okay.  Next,  a  plus 
sign  in  a  subdivision  means  +1  and  a  minus  sign 
means  -1.  Now  I  shall  list  the  first  few  Rade¬ 
macher  functions  using  this  notation  with  16 
sub-intervals.  Let's  see  if  a  pattern  emerges. 
(A  sketch  of  each  function  is  shown  beside  the 
function  to  give  a  picture  along  with  the  de¬ 
notation) 


r2  4+'  - H-H- -  P~]  (~~1 — 


Rj  H--  FU  U  (J  ll 

«4  ^-6-+^-  muTjwiiUiJ 

Note  the  following  things:  the  subscript  on  R  is 


family  of  Walsh  functions,  I  want  to  tell  you 
some  of  their  characteristics.  Generally  speak¬ 
ing,  Walsh  functions  are  defined  an  the  unit 
Interval,  C  to  1,  and  in  this  interval,  they 
take  on  the  values  ±  1.  They  flip  back  end  forth 
between  plus  and  minus  one  in  a  fairly  regular 
and  highly  predictable  way.  The  independent 
variable  on  this  interval  is  0,  a  normalized 
kind  of  time.  0  ■  t/T  where  t  is  ordinary  time 
and  T  might  be  called  a  sampling  interval.  Walsh 
functions  have  some  characterlsitics  which  make 
them  interesting  to  mathematicians  as  well  as  to 
engineers.  I  will  just  mention  these  in  passing. 
Walsh  functions  are  orthogonal,  rormalized,  and 
complete.  Orthogonal  means  that  if  you  multiply 


an  integer,  and  the  number  of  complete  square- 
wave  cycles  the  function  makes  in  the  interval 
is  2'*  when  the  subscript  is  i.  The  excep¬ 

tion  is  R0,  which  is  +1  over  the  whole  interval. 
Easy?  You  bet. 

Now  the  next  step  is  to  define  for  any  who 
may  not  know  it,  the  Gray  code.  If  I  count  in 
binary  from  0  to  7,  I  can  make  a  table  like  the 
onp  shown  below. 


Decimal  number 


Gray  Code 


*This  work  was  supported  in  part  by  Grant  GN- 
534.1  from  the  Office  of  Science  Information  Ser¬ 
vice,  National  Science  Foundation  to  the  Computer 
and  Information  Science  Research  Center,  Ohio 
State  Ur.iversltv,  Columbus,  Ohio. 
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The  Cray  code  has  two  Interesting  properties. 
(1)  As  you  progress  from  0  to  7,  only  one  digit 
at  a  tine  changes.  (2)  It  Is  helpful  In  defining 
Walsh  functions.  It  Is  particularly  easy  to  con¬ 
vert  a  nunber  from  binary  to  Gray  code.  If  the 
binary  number  is  bn  bn-i  bn_2....bi  then  the  Gray 
code  is  gn  gn_x  gn^2....g^  and  the  g's  are  found 
from  the  b's  by  the  following  rules: 


gn-l  -  bn  ©  bn.j 
8n-2  *  bn-l  ©  bn-2 

81  "  1*2  ®  bj 

The  symbol  ©  means  addition  modulo  2. 

Now,  at  last,  we're  ready  to  generate  some 
Walsh  functions.  A  Walsh  function  is  character¬ 
ized  by  two  parameters.  J  is  the  sen jency  (more 
about  that  later)  and  8  is  the  Independent  vari¬ 
able.  To  find  wal  (j,0) 

1.  Write  J  in  binary 

2.  Convert  J  to  Gray  code 

3.  Multiply  together  all  Pademsuhsr  func¬ 
tions  whose  subscripts  correspond  to  the 
position  of  the  1-bits  in  the  Gray  code 
number.  They  line  up  as  shown  below: 

Code  word  . . .  g*  g3  g2  gl 

Radenacher  ...  R$  R3  R2  Rj 

I  will  do  an  example,  then  show  you  a  list 
of  Walsh  functions.  To  find  wal  (13,8) 

1.  13  -  1101,  in  binary 

2.  Gray  code  •  1011 
R2  .  Rx 


wal  (5,8) 
wal  (6,8) 
wal  (7,8) 
wal  (8,8) 
wal  (9,8) 
wal  (10, e) 
wal  (11,8) 
wal  (12,8) 
wal  (13,8) 
wal  (14,0) 
wal  (15,8) 


- f+ — H-H- 


+-+ — b-H—f — b-b 


+-4~- 


| - — f -f—f-  - 


1/2 


sal  (3,e) 
cal  (3,8) 
sal  (4,8) 
cal  (4,8) 
sal  (5,8) 
cal  (5,8) 
sal  (6,8) 
cal  (6,8) 
sal  (7,8) 
cal  (7,8) 
sal  (8,8) 

8  axis 


Now  let's  see  what  sore  other  interesting  prop¬ 
erties  are.  Each  time  one  of  the  functions 
changes  from  +  to  -  or  -  to  +,  It  Is  an  occurence 
called  a  zero-crossing,  a  most  descriptive  name. 
Also,  there  is  a  zero-crossing  at  the  origin 
(6  *  0)  for  each  of  those  functions  which  has  odd 
symmetry  about  8  »  1/2.  (they  also  end  with  a  -). 
rhis  is  true  for  every  other  one  in  the  table. 

If  we  count  the  number  of  zero  crossings  in  each 
of  the  previous  functions,  we  find  the  following 
numbers:  0,2, 2, 4, 4, 6, 6,  etc.  with  the  last  one 
having  16.  Remember  the  word  I  used  a  bit  ear¬ 
lier  -sequency?  Well,  sequency  is  defined  as 
one  half  the  average  number  vi  zero-crossings  in 
the  interval.  With  this  in  mind,  we  can  list 
the  sequencies  of  the  first  sixteen  Walsh  func¬ 
tions.  They  are,  from  top  to  bottom,  0,1, 1,2, 2, 
3, 3, 4, 4, 5, 5, 6, 6, 7, 7, 8.  In  ether  words,  there 
are  two  functions,  one  with  odd  symmetry  and  one 
even,  at  each  sequency  from  0  to  8,  except  for 
the  first  and  last.  In  order  to  point  out  the 
slmilaritv  between  these  functions  and  the  also 
orthonormal  set  of  sines  and  cosines,  the  appro¬ 
priate  Walsh  functions  have  been  given  the  names 
"cal"  and  "sal"  as  follows: 

wal  (2n-l,  8)  ■  sal(n,6) 

wal  (2n,6)  "  cal(n,8) 

except  for  0  sequency  where  all  we  have  is  wal 
(0,8).  The  index  n  for  sal  and  cal  is  their  se¬ 
quency.  There  are  the  names  listed  on  the  right 
in  the  previous  table. 

Now  that  we  can  define  Walsh  functions  at 
will ,  and  put  the  appropriate  label  (cal  or  sal) 
on  them,  as  well  as  find  their  sequency,  we  are 
ready  to  start  working  with  them.  This  sectior 
might  be  called  "What  ore  they  good  fcr7" 

Using  Walsh  functions  to  represent  signals 
is  possibly  the  most  Important  application  today. 
This  application  is  exactly  analogous  to  the  use 
of  sines  and  cosines  to  represent  a  function  in 


terms  of  what  we  all  learned  as  Fourier  Series.  Let  the  xj's  take  on  the  following  values:  0,0, 

The  difference  now  Is  that  the  function  Is  repre-  1,1, 0,0, 1,1,.  This  Is  a  square  wave  with  ae- 

sented  as  a  series  of  Walsh  functions  In  the  quency  2  and  some  d.c.  A  series  of  additions 

"sequency  domain."  I  would  like  to  digress  for  and  subtractions  gives  the  following  results: 

just  a  moment.  All  the  masses  of  literature  that 

have  been  released  to  the  scientific  community  a(0)  •  4  ac(2)  -  0 

since  the  famous  Cooley-Tukey  algorithm  appeared 

l(j  print  have  referred  to  the  digital  Fourier  aa(l)  ■  0  as(3)  "  0 

Transform.  They  call  it  a  discrete  version  of  a 

continuous  process.  1  prefer  to  think  of  It  as  ac(l)  »  0  ac(3)  ■  0 

what  It.  really  Is:  a  Fourier  Series.  If  you 

think  this  way,  then  the  Fourier  Transform  be-  as(2)  «  -4  ag(4)  “  ® 

comes  a  special  case,  using  an  infinitely  fast 

sampler.  Now  let's  get  back  to  the  subject  and  a(0)  represents  the  d.c.,  while  a8(2)  is  due  to 

talk  of  a  Walsh  series  for  a  function.  A  good  the  component  at  sequency  2.  Now  let's  try  an 

way  to  represent  the  formulation  of  a  Walsh  interesting  thing.  Shift  the  phase  of  the  input 

series  Is  by  a  matrix  equation:  signal,  by  letting  the  x's  be  (In  order)  0110 

0110.  Now,  computation  of  the  Walsh  coeffl- 
[W]  .  (X)  »  (A)  cients  gives 


where  [W]  Is  the  matrix  of  Walsh  functions,  fX] 
is  a  column  vector  of  sampled  values  of  the 
original  function,  and  [A]  a  column  vector  of 
Walsh  coefficients. 

The  Walsit  matrix,  because  of  the  nature  of 
the  functions  Is  simply  an  array  of  plus  and 
minus  ones.  With  the  functions  as  defined  here, 
the  preceding  table  is  the  Walsh  matrix  for 
N  “  16.  Now  you  know  why  the  so-called  "Walsh 
Transform"  is  so  fast.  All  you  do  to  generate 
the  Walsh  coefficients  is  add  and  subtract,  and 
if  you  do  it  according  to  the  Cooley-Tukey  algo¬ 
rithm,  it's  really  fast-  Another  nice  thing 
about  this  representation  of  Walsh  functions  is 
that  the  original  signal  can  be  regenerated  oy 
multiplying  the  column  vector  of  Walsh  coeffi¬ 
cients  by  the  same  Walsh  matrix,  and  dividing  by 
N.  In  other  words,  the  Walsh  Matrix  Is  its  own 
Inverse,  within  a  constant  multiplier  N.  In 
terms  of  a  matrix  equation. 


a(0)  »  4  «c(2)  *  -4 

a„(l)  -  0  as(3)  -  0 

«cO)  »  0  ac(3)  -  0 

as(2)  -  0  as(4)  -  0 

This  example  illustrates  that  the  Welsh  trans¬ 
form  is  sensitive  to  the  phase  of  the  input 
signal  as  well  as  to  the  sequency.  This  is  not 
true  for  the  exponential  form  of  Fourier  Series, 
although  It  Is  for  the  sine-cosine  form,  as 
might  be  expected. 

If  we  sum  the  squares  of  the  terms  at  the 
various  sequencles,  we  have  the  equivalent  of  a 
power  spectrum,  called  appropriately  enough,  the 
Walrh  spectrum.  Note  that  the  spectra  for  the 
previous  two  examples  are  the  same,  as  they 
should  be;  d.c.  term  and  a  term  at  sequency  2. 


[X]  -  £  •  [W]  •  [A]  -  £  •  [Wj  •  [W]  *  fX] 

and  (WJ  •  [W]  -  I  -  [I] 

where  (Ij  Is  an  NxN  Identity  matrix.  Let's  do  a 
simple  example,  for  N  »  8.  Let  the  sample  values 
be  x0  through  x7,  and  the  Walsh  series  coeffi¬ 
cients  be  given  by  ac  (n)  or  a8(n).  (Except  for 
the  coefficient  of  wal(0,8)  which  is  a  (0).) 

Here  the  subscript  c  or  s  refers  to  cal  or  sal. 


Let  me  end  this  series  of  Ideas  with  a  sim¬ 
ple  statement.  Vou  can  mull  it  over  on  your  own 
time.  A  time- limited  square  wave  function  (such 
as  one  obtains  ot  the  output  of  a  sample-and- 
hold  device)  can  be  exactly  represented  by  a 
finite  number  of  Welsh  functions.  You  can't  say 
that  about  sines  and  cosines! 

Another  interesting  sec  of  orthogonal,  com¬ 
plete  functions,  which  mey  be  normalised  if  you 
desire,  Is  the  set  of  Haar  Functions.  I  will 
now  list  enough  Haar  Functions  to  allow  you  to 
generate  as  many  more  as  you  like.  As  with  the 
Walsh  Functions,  the  Interval  is  divided  into 
l/2n  spaces.  For  this  list,  use  sixteen  divi¬ 
sions.  Capital  H  with  superscripts  and  sub¬ 
scripts  will  denote  the  Haar  Functions.  The 
plus  sign  again  means  +1,  the  minus  sign  means 
-1,  and  now  the  number  0  means  exactly  that  - 
xero. 

Note  the  following  characteristics  of  the 
Haar  Functions:  for  the  subset  H^J ,  there  are 
n  *  2i-l  different  functions  in  the  Interval, 
and  1  <  k  <  n. 


.*  *C?  '¥  *•  ■ 


H°  -H-H-H-H-H-H-H-H 

K*  4-4-H-H-H - 

H*  -H-H - 00000000 

H*  000000004+++ - 

H3  4+-000000000000 

h3  0000++— 00000000 

H*  OOOOOOOOH— 0000 

H?  000000000000++— 

4 

hJ  +-00000000000000 

H*  00+-000000000000 

H*  OOOOf-OOOOOOOOOO 

H*  OOOOOOf-OOOOOOOO 

4 

H*  000000004-000000 

H*  OOOOOOOOOOf-OOOO 

o 

0000000000004-00 

H*  000000000000004- 

8 


where  [W]  is  the  Walsh  matrix  and  [X]  Is  an  image 
(actually  an  nxn  portion  of  an  image). 

First,  consider  an  image  containing  infor¬ 
mation  at  sequency  1  In  the  horizontal  direction 
and  sequency  0  in  the  vertical  direction,  as 
shown  below. 


0  110 
I  0  1  1  0 
|0110 

1°  1  1  °. 

Image 


The  transformation  is  shown  below. 


+  +  +  + 
+  +  -  - 
+  —  + 
+  -  +  - 


ouo] 
0  110 
0  110 
0  110 


+  +  +  + 
+  +  — 
+  -  -  + 
+  -  +  - 


8  0 

-8  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

The  8  in  the  upper  left  corner  is  the  d.c. 
or  average  term  and  the  -8  is  due  to  the  sequency 
1  component.  Note  that  the  -8  lies  in  the  first 
vow,  third  column,  indicating  sequency  1  in  the 
horizontal  direction. 


Next  consider  an  image  with  0  sequency  in 
the  horizontal  direction  and  sequency  2  in  the 
vertical  direction. 


01/21  0  axis 

Also  note  the  interesting  relationship  to  the 
Rademacher  Functions. 


0  0  0  0 
1111 
0  0  0  0 
1111 


k  -  1 


-  R 


J 


With  this  in  mind,  it  is  reasonable  to  talk 
of  a  "sequency"  for  Hear  Functions,  although  a 
more  Important  parameter  is  delay,  which,  for 
Hear  Functions,  la  enalagous  to  the  phase  of 
sines  and  cosines.  For  the  Hear  Functions,  the 
delay  is  given  by  k  -  1.  To  normalize  the  Hear 
Functions  of  order  j,  each  should  be  multiplied 
by  2^-1  ”  D/2.  An  application  will  be  described 
later. 


For  the  remainder  of  this  paper,  I  shall 
point  out  some  of  the  many  actual  as  well  as 
potential  applications  of  Walsh  Functions,  and 
other  square-wave  functions.  Perhaps  I  will  be 
asking  more  questions  than  I  answer. 

1.  Two-dimensional  image  transformation. 

Two  very  active  persons  in  this  area  are 
Andrews  and  Pratt. [2]  They  were  certainly  amonr 
the  first  to  point  out  the  advantages  of  using 
Walsh  Functions  for  image  transformations  rather 
than  sines  and  cosines.  I  thought  it  might  be 
fun  to  examine  several  simple  cases  in  order  to 
see  exactly  what  a  Walsh  Transform  does  to  an 
lMge.  As  I  define  the  two-dimensional  Walsh 
Transform,  it  is  a  matrix  operation  given  by 

Mix]  (w] 


Image 

The  transformation  is  shown  below. 


p  ~1 

r 

r  — 

+  +  +  + 

0  0  0  0 

+  +  +  + 

3  0  0  0 

+  +  — 

1111 

+  +  -  - 

0  0  0  0 

+  —  + 

0  0  0  0 

+  -  -  + 

0  0  0  0 

+  -  +  - 

1111 

+  -  +  - 

-8  0  0  0 

Note  that  the  d.c.  term  is  in  the  same 
place,  while  the  sequency  2  term  in  the  vertical 
direction  is  Indicated  by  the  -8  in  the  fourth 
row,  first  coltnn. 

Finally,  using  the  notation  that  the  Trans¬ 
form  array  is  [T],  the  original  image  can  be 
recovered  by  exactly  the  same  matrix  operation 
as  the  one  which  generated  it,  with  a  factor  of 
1/N2.  This  is  shown  in  equation  form  below. 

[X]  -  £2  -IWMT].[W] 

[X]  -  I  .[W).IW].(X].^[W].[WJ 

[xj  -  m.txi.m  -  [x] 

[I]  is  the  identity  matrix. 

2.  Sequency  filtering. 

It  is  possible  to  do  filtering  based  upon 
sequency  rather  that;  frequency  in  two  different 
ways:  the  first  way  utilises  sample  and  hold 
amplifiers,  switches.  Integrators,  multipliers, 
counters,  etc.  Any  type  of  filter  can  be 
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synthesized;  lowpass,  bandpass,  highpass,  etc. 
[3]  The  other  approach  is  to  use  a  digital 
computer,  perform  the  transformation  to  a  Walsh 
series,  then  retain  for  outputting  only  those 
sequency  terms  which  are  to  be  passed  hv  the 
filter.  The  feature  that  makes  this  approach 
feasible  is  the  speed  with  which  the  transform 
can  be  computed.  There  will  of  course  be  a  time 
delay  in  both  cases.  Note  that  a  sequency  fil¬ 
ter  can  differentiate  between  sal  and  cal.  An 
RLC  filter  has  no  such  capability. 

3.  Non-linear  system  analysis. 

A  non-linear  system  is  often  described  hy  a 
transfer  characteristic  as  shown  below. 

output  / 


7.  Resolution  of  point  targets. 

If  two  closely  spaced  point  targets  ire 
illuminated  with  a  sine  wave,  the  received  sig¬ 
nal  will  have  the  appearance  of  the  curves  below 
due  to  small  differences  in  path  length. 


AAAAr 

-WW 

A/VW 


i — i  i _ i  k — »  i — p 

-rout 

«vv 


If  analysis  by  sine-cosine  Input  waves  is  per¬ 
formed,  the,  output  will  be  distorted  sine  wave, 
expressable' as  a  fundamental  and  harmonics  of  a 
Fourier  Series.  If,  however,  a  square  wave  is 
the  input,  the  output  will  also  be  a  square  wave 
at  exactly  the  same  sequency  with  d.c.  bias. 

Now  all  that  is  left  is  to  make  something  out 
of  that. 

A.  Spectrcscopy. 

The  two-beam  interferometer  spectrometer 
works  by  first  forming  an  interferogram,  then 
by  means  of  an  inverse  Fourier  Transform,  re¬ 
constructing  the  spectrum.  Interest  in  this 
technique  is  currently  high  because  of  the  de¬ 
creasing  cost  and  increasing  speed  of  performing 
this  transformation  digitally.  Interestingly 
enough,  the  processing  can  be  done  by  using  a 
mask  with  transparent  and  opaque  portions  encoded 
so  as  to  perform  a  Walsh  (Hadamard)  transform. 

The  result  seems  to  be  increased  speed  with  no 
less  cf  resolution. [41 

5.  Multiplexing. 

The  multiplication  heorems  of  sine  and  cos¬ 
ine,  applicable  to  amplitude  modulation,  yield 
upper  and  lower  sidebands.  Tills  is  not  true  in 
the  case  of  Walsh  Functions.  The  multiplication 
of  wal(j,6)  by  wal(k,8)  yields  wal[(J$k),6]  where 
again  ©  stands  for  bit-by-bit  addition  modulo  2. 
So  you  might  say  a  Walsh  amplitude  modulation 
has  a  single,  sometimes  upper,  sometimes  lower 
side-band.  This  feature  leads  to  Walsh  function 
multiplexing  which  is  most  interesting. [5] 

6.  Radiation  of  Walsh  waves. [1] 

Perhaps  the  most  important  reason  to  be  con¬ 
sidering  the  radiation  of  Walsh  waves  (electro¬ 
magnetic  or  acoustic)  is  this:  there  la  a  differ¬ 
ence  between  a  Walsh  wave  at  sequency  a,  and 
another  Walsh  wave  transmitted  at  sequency  s’  but 
Doppler  shifted  to  sequency  8.  The  application 
of  this  feature  should  be  apparent. 


The  composite  waveform  will  be  altered  on 
the  first  end  last  period  of  the  sine  wave  only. 
If  illuminated  by  a  Walsh  wave,  the  effect  of  the 
other  target  is  seen  during  the  entire  period  of 
the  pulse.  This  seems  to  indicate  superior  reso¬ 
lution  capability  for  the  Walsh  wave. 

8.  Information  Content. 

A  sine  wave  has  vanishingly  little  informa¬ 
tion  content.  Rive  me  four  points  without  vio¬ 
lating  the  sampling  theorem  and  I'll  give  you 
the  whole  sine  wave.  A  Walsh  function,  on  the 
other  hand  has  the  property  that  the  more  samples 
you  get,  the  more  information  you  have  about  it. 
You  nay  have  to  think  about  that  for  e  while. 

I  know  I  did. 

9.  Speech  synthesis  and  analysis. 

Two  of  my  graduate  students  have  used  Haar 
Functions  in  connection  with  speech.  The  first 
of  these  was  a  speech  synthesis,  redundancy- 
removal  effort  conducted  by  Meltzer.[71  The 
motivation  was  due  to  the  fact  that  since  hard- 
clipped  speech  is  still  recognizable,  the  infor¬ 
mation  may  be  contained  iu  the  zero-crossings. 

The  Haar  Functions  are  extremely  well  suited  to 
v  zero-crossing  context.  Briefly,  Meltzer's 
results  indicate  that  with  sampling  at  5kHz  and 
a  subsequent  Haar  Transform,  at  least  one  half 
of  the  coefficients  may  be  eliminated  without 
loss  of  intelligibility  on  playback.  It  is 
theorized  that  up  to  one  half  of  the  remainder 
may  alsc  be  removed,  but  the  question  is  which 
one-half  It  seems  to  vary  depending  upon  the 
sounds  present.  Current  investigation  into 
analysis  using  Haar  Functions  is  just  starting. 

It  is  too  soon  to  give  results. 

So  what's  next?  As  far  as  I'm  concerned, 
the  application  of  Walsh  functions  as  well  a* 
other  square-wave  functions  such  a3  Haar  func¬ 
tions  is  a  wide-open  field.  As  evidenced  by  tne 
broad  subject  list  from  the  several  Walsh 


i 


Function  Workshops  1.6]  the  Interest  is  becoming 
more  general,  and  the  applications  more  diverse. 
I  cannot  say  "What's  next".  I  can  only  see  a 
lot  of  interesting  times  ahead  for  me,  my  grad¬ 
uate  students,  and,  perhaps  some  of  you. 


10,  1968. 

4.  Decker,  J.A. ,  and  lfan.it,  M. ,  "fxperimental 
Operation  of  a  Padamard  Spectrometer,"  Ap¬ 
plied  Ootics.  vol.  8,  no.  12,  Dec.  1969. 
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WA15H  FUNCTIONS  AND  HADAMARD  TRANSFORM 
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Manhattan,  Kansas  66502 
Abstract 


This  is  a  tutorial  paper  vhich  deals  vith 
the  fundamental  aspects  of  the  transform  prop¬ 
erties  of  Walsh  functions.  By  appropriately 
sampling  Walsh  functions,  it  is  shown  that  one 
can  generate  a  class  of  matrices  vhich  have 
t ran v form  properties.  These  matrices  are 
called  Hadamard  matrices.  The  name  of  the 
corresponding  transform  is  the  Walsh-Hadamard, 
or  Hadamrd  transform  (WHT  or  HT). 


The  Walsh-Hadamard  analysis  resembles  the 
Fourier  harmonic  analysis  in  both  geometrical 
and  analytical  characteristics.  While  the 
Fourier  bases  are  sinusoids  with  harmonic  fre¬ 
quencies,  the  Walsh-Hadamard  bases  are  Walsh 
functions.  Since  Walsh  functions  are  square 
waves,  the  corresponding  Hadamard  matrices 
consist  of  elements  which  are  -1  and  hence  en¬ 
able  relatively  easy  information  processing  in 
several  applications. 


Introduction 


Walsh  functions1  and  their  transforms-  have 
found  recently.*  number  of  applications  in  di¬ 
verse  areas.  The  symposium  on  applications 
of  Walsh  functions14  held  annually  is  a  testi¬ 
mony  to  this.  The  object  of  this  paper  is  to 
present  a  tutorial  exposition  on  the  transform 
properties  of  Walsh  functions. 


Walsh  Functions 


Walsh  functions,  which  form  a  complete  or¬ 
thonormal  set  of  rectangular  waves,  can  be  de¬ 
fined  several  vays.  ,T’  The  definition1 
adopted  here  is  based  on  Rademacher  functions, T 
which  form  an  incomplete  orthononsal  set,  and 
Cray  code.  Rademacher  functions,  3j(t)  are 
periodic  rectangular  pulses,  with  21"1  cycles 
on  the  unit  interval  and  alternate  between  +1 
and  -1,  with  the  exception  of  RQ(t)  which  is  a 
unit  step  function  (Fig.  1),  Walsh  functions, 
Wal(m,  t)  are  developed  as  products  of  the 
Rademacher  functions  based  on  the  Gray  code, 
i.  e.,  convert  m  to  binary,  m»(bn  b0_i...b2  bj) 
binary,  then  the  Gray  code  of  a  is  Ig,.  k  ... 
g2  g,)  binary,  where  "l 


Sn-l“*n  •  V» 


g2«bj  ®  b2 
gl»b2  • 


where  the  symbol  ©  denotes  addition  modulo  2. 
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Waltm,  t)-(R(t))gn  (R_  (t )  )**  ^ . . .  (R-(t)  f* 
(Rj(t))«l  “  1 


For  example,  when  m*6=(110)binary,  its  Gray 
code  is  (lOl)binary,  and  hence 


Wal(6,  t)a(R3(t) )  (Rj(t) ) . 


The  first  set  of  eight  Walsh  functions  with 
corresponding  sine  and  cosine  harmonics  super¬ 
imposed  on  them  is  shown  in  Fig.  2.  Unlike 
sinusoidal  functions,  the  interval  between  suc¬ 
cessive  zero  crossings  may  not  be  the  same  for 
a  given  Walsh  function.  The  term  analogous  to 
frequency  ia  sequency,11  which  is  based  on  the 
number  of  sign  changes,  g.  Sequency  is  one 
half  che  rnsnber  of  zero  rossings  per  unit  in¬ 
terval  (zero  crossing  at  the  left  end  only  and 
net  at  the  right  end  is  counted.).  In  terms 
of  sign  changes,  sequency,  s,  is  defined  a3 


5*(g+i)/2,  g  odd, 
=g/2,  g  even. 


Walsh  functions  can  be  further  classified  as 
"sal"  (s_ir.e-WAISH)  or  cal  (cosir.e-WAISH)  based 
on  the  odd  or  even  symmetry  of  Wal(m,  t)  at 
t=l/2,  i.  e.. 


Wal(2n-1,  t)*sai(m,  t) 
Wal(an,  t)=eal(m,  t) 


(sequencyom) 


Discrete  Walsh  Transform 


The  evolution  of  FFT  (Fast  Fourier  Transform) 
and  the  digital  computers  have  brought  digital 
signal  and  image  processing  and  digital  commun¬ 
ications  into  limelight.  The  discrete  version 
of  the  Walsh  transform  is  based  on  the  sampled 
values  of  the  Walsh  functions  and  the  sampled 
data  of  the  time  series.  The  discrete  Walsh 
transfers1  of  an  N-oeriodic  sampled  data  x(K), 
K*0,l,...,8-1  and  n»log2Jt  is  given  by 


(X(n);»  n(W(n))  (x(n)). 


(1) 


where  {^(n))  is  the  H-diaer.sional  data  (coluan) 
vector,  (X(n))  is  the  H-dimensional  Walsh  trans- 
for  (column)  vector,  and  |V(n)]  is  the  (2nx2n) 
Walsh  matrix.  As  (W(r.)]  is  orthogonal  and  sym¬ 
metric,  the  inverse  Walsh  matrix  in 


{s(ft))-(W(n))  { )C( n ) > - 


(2) 


(5) 


The  transform  vector  (X(n)}  represents  the  ce- 
quency  decomposition  of  (x(n)},  whereas  the  DP? 
{discrete  Fourier  transform)  decomposes  the  da¬ 
ta  vector  into  its  frequency  components. 


(x(n)}  =  (il(i) ]  (£x(n)}, 

where  (^(n))  is  tne  H-dimensior.al  Hadamard 
transform  (column)  vector. 


Hadamard  Transform 

The  rows  of  the  Walsh  matrix  can ,be  rear¬ 
ranged  to  obtain  Hadamard  matrix^  which  has 
a  simple  recursive  structure.  This  rearrange¬ 
ment  is  based  on  the  following  simple  rule) 

Row  of  Walsh  matrix,  m=(bn  b^.j...^  bj)binary, 
Gray  code  of  m  is  (gn  gk_j...g2  g^binary 


Fist  Hadamard  Transform 


By  factoring  (H(n)]  into  n  sparse  matrices, 
an  efficient  algorithm  for  fa3t  computation  of 
the  transform  can  be  developed.  ”  For  ex¬ 
ample,  (H(;)]  can  be  factored  as 

(H(3) )  =  [Hit 3)]  [H2(3)l  [H-3( 3)  ] 


Row  of  Hadamard  matrix,  t=(gj  g2...g_  g^_,)bi- 
nary,  which  is  the  lit  reversal  of  the  Gray 
code  of  m.  For  example  let  m=2«(010)binary , 
Gray  coda  of  2  is  (Oll)binary  whose  bit  rever¬ 
sal  is  (110)binary*6.  For  K>*8,  the  Walsh  ma¬ 
trix  based  on  the  sampled  data  of  tne  Walsh 
functions,  and  the  corresponding  Hadamard  ma¬ 
trix  are. 


[dl(3)] 


il  1| 

Ij  -II 

~ir  ti 


h.  r 


\l~h * 


Sampled  data  of 
Walsh  function 

Wal(0,  t)  Il  1  1  1  1  1 
Walfl,  t)  *  sal(l,  t)  1111-1-1 
Wal(2,  t)  »  cal(l,  t)  11-1  -1  -1  -1 
Wal(3,  t)  =  sa?.(2,  t)  11-1-11  1 
Wald,  t)  =  cal(2,  t)  [W(3)]=  1-1-1  1  1-1 
Wal(5,  t)  *  sal{3,  t)  1-1-1  1-1  1 
Wal(6,  t)  *  cal(3,  t)  1-11  -1  -1  1 
Wal(7,  t)  -  said,  t)  1-11-11  -1 


Walts,  t)  *  sal{3,  t) 
Wal(6,  t)  “  cal(3,  t) 
Wal(7,  t)  -  sal(l*,  t) 
and 

Wal(0,  t) 

Wal(7,  t) 

Walt 3,  t) 

Wald ,  t) 

Wal(l,  t) 

Wald,  t) 

Wal(2,  t) 

Wal(5,  t) 


11111111 
1-1  1  1-1  1-1 

1  1-1-1  1  1-1-1 

1  -1  -1  1-1-1  1 

1  1  1  1  -1  -1  -1  -1 

1-1  1-1-1  1-1  1 

1  1  -1  -1  -1-1  1  1 

1-1-1  1  -1  11-1 


Row  of 

[H(3)J 

0 

u 

6 

2 

3 

7 

5 

1 

Row  of 

[W(3)J 


Number  of 
sign  changes 


Number  of 
sign  changes 
0 
7 
3 


Sequency 


Sequency 

0 

k 

2 


Hndacard  matrix  of  any  order  can  be  generated 
recursively  from 


[ li { 0 ) )  =  1,  and 


(H(K+l)]  = 


jUUK)  ]  i -IH(K) 
[H( 1 ) 1  ®  [H{K)1 


K  =  0,  1,  2,. 


where  [Hti))  *  ({  _{j  and  the  symbol  @  denotes 
Kronacker  product.  Hadmard  matrix  is  both  sym¬ 
metric  and  orthogonal,  i.  w. .  (H(n)]  [H(n)]  » 
HIjj,  where  I{{  is  the  (N  x  N)  Identity  matrix. 
The  Hadamard  transform  (HT)  of  (x(ri)}  and  its 
Inverse  are  resoectlvely  defined  as,  '** 

{ax(n)>  -  ^  [H(r.)J  {a'n»,  d) 


[«2( 3)1  = 


[H3(3))  = 


If  I2 

!i2  x2 
lX2 


fd  d 

b  -ij- 


The  signal  flow  graph  based  on  (6)  is  shown  in 
Fig.  3.  The  fast  algorithm  requires  about  N 
loggH  arithmetic  operations  (Hadamard  transform 
involves  additions  and  substractions  only  as 
all  the  elements  in  the  transform  matrix  are  +1 
or  -1)  compared  to  required  by  the  direct 
methord.  Factoring  of  transform  matrix  of  any 
order  and  developing  the  corresponding  flow 
graph  is  straightforward. 


®ower_S£eotrun 

The  pover  spectrum  invariant  to  the  cyclic 
shift  of  the  sampled  data  can  be  developed 
using  the  shift  matrix.  If  (x'f''(n)}  ip  (x(n)} 
shifted  cyclically  to  the  lefv.  by  l  olaces  and 
if,  {S>-,'(p)  }  is  the  HT  of  the  shifted  sequence 
(x'^in)},  then 

{8x(l)(n)>  =  i  fH(n)J  (x(t)(n)> 

=  \  (H(n) ]  [a(t)(«i)l  (x(u) }  (7) 

=  i  tH(n)]  (M(i)(n)]  [H(n)]  {Bx(n)} 

where  [M  (n)]  is  Ij|  whose  columns  arc  shifted 
to  tlie  right  cyclically  by  i  places.  The  trans- 
foms  of  the  shifted  and  the  original  sequences 
arc  related  through  the  shift  matrix,  [S^'(n)], 
i.  e.  , 

=  (3U)(n)]  {Bx(n)>,  (8) 

where  [S^(n)J  =  fH(n)  ]  [M^(n)j  (H(n)}  re¬ 
presents  the  similarity  transformation. 

The  shift  matrix  has  block  diagonal  ortho¬ 
normal  structure.  For  .’}  =  8,  and  1  =  1,  the 
shift  matrix  becomes 


(S<^(3)]  - 


?n  “  2-1  Bx2(K) 


Sequency 

1,3, 5,7,. ..(3  -  1) 


i0  -11 

U-Ql  _ 

I  Viill'li 

!  i;  i  1 : 


where  each  of  the  block  diagonal  matrices  is 
orthonormal.  This  is  the  key  tc,  the  invariance 
of  tiie  power  spectrum  to  the  periodic  shift  of 
tnc  time  series.  Also  the  oower  spectrum  for 
!l  =  6  is  as  follows: 


beouencv 
PQ  =  B/(0)  0 

P,  *  3x2(1)  J* 

2  2  U0) 

P2  =  Bx^(2)  +  Bx  (3)  2 

p3  =K|U  BX2(K).  1,3 

In  general  for  any  M  =  2n,  the  power  snoot run 
and  its  sequency  composition  is  as  follows: 


P0  =  B/(0) 

21  - 

22-1  a,  , 

P2  3  K^-»  ^ 


3 

Pa  =  V*  .  B  2(k) 
3  k=23"1  x 


fienuer.cy 
0  _ 


An  inspection  or  (11)  3hcvs  that  the  Hadamard 
power  ipcctral  points  do  not  represent  Individ¬ 
ual  sequencies  but  groups  of  seouencies.  But 
tiiis  grouping  is  not  arbitrary,  but  is  based  on 
the  half-wave  symmetry  structure,  i.  e.,  each 
group  contains  a  fundamental  and  all  the  odd 
narmonics  relative  to  that  fundamental. 

Modified  Hadamard  Transform 

The  HT  power  spectrum  (11)  can  be  computed 
directly  using  the  modified  Hadamard  transform 
(MHT).  The  MHT  of  (x(n))  and  its  inverse  are 
respectively  defined  as, 

(F(n)}  =  jj  (D(n)J  (x(n)),  (12) 


{ x ( n ) }  =  [ D( n ) ]  (F(n) ) ,  (13) 

where  (F(n)}  is  the  .'l-dimensional  MHT  (column) 
vector.  The  transform  matrix  [D(n)J  is  ortho¬ 
gonal  and  can  be  genc.-ated  recursively  as  fol¬ 
lows  : 

lD(xj)  [  [D(K)J  (lit) 

[D(K+l)J  =  --  -  -  -  r  -  - - K  =  0,1, 

2  /a  I  -2K/2  I,K  2,... 


with  [D(0) )  =  1.  For  tl  =  8,  the  transform  ma¬ 
trix  is. 


11  1  l'l  1  1  1 

1-1  1  -1  1  1  -1  1-1 

Jz  0  -/g  0  V2  0-/2  0 

0  ft  0  /£  0  -/t 

2  Ij,  |  -2  h 


(P(3) ) 


and  the  flow  graph  for  fast  compulation  of 
(F(3))  is  shown  in  rig.  It.  As  in  the  case  of 
HT,  the  flow  graph  is  based  on  factoring  [ D( 3) ] 
into  sparse  matrices  i.  e.  , 

(D(3)]  =  [Djif  3)  I  (D2(3)l  CD3(3> ] 


(Dx(3)]  =  j/2  I2l 

- r 

'  XU  > 


[D2(3)]  =  I2  -I2, 


ID3( 3) ) 


li,  lb 

lu  'lit  • 


The  MHT  requires  -iuc.-i  less  numoer  of  arithmetic 
operations  compared  to  HT,  because  of  the 
sparseness  in  [D(n)l  and  consequent  increased 
sparseness  in  its  factors.  Ccr parison  of  Fig¬ 
ures  3  and  b  yields  the  following  relationships 
between  the  BT  and  M3T  coefficients: 

3„(0)  =  F(0) ,  3x(l)  =  F(l), 


fBx(2)) 

,  fF(2) 

=  [  H  ( 1 )  ]  j 

IBx(3); 

n  [f( 3)  J 

and 

Vu>' 

(  ?(!»)' 

Bx(5) 

F(5) 

1=  I  ( H  ( 2 ) ) 

Bx(6) 

f(6) 

Bx<7> 

U(7). 

From  (10)  and  (17)  it  is  clear  that  the  BT 
power  spectrum  can  also  be  expressed  as , 

P0  =>  Bx2(0)  =  F2(0) 

P,  =  B  2(l)  =  F2(l) 

3  2/  ,  3  2/  \  (l8> 

P2  *  k£2  Bx  (K>  =  K h  F  (K) 

p3  •  iu  bx2(k)  -  kL  f2(k) 

or  in  general, 

Pn  =  B  2(0)  =  F2(0) 

°  (19) 

2m-l  „  2™-!  o 

Fn  =  l  ,  B  2(k)  =  Z  F2(k),  m  =  1,2, ... ,n. 
”  K=2ra'1  X  K=2m_1 

The  BT  power  spectrum  can  thus  be  evaluated 
directly  without  computing  (Bx(n)}. 

Multidimensional  Hadamard  Transform 

As  with  other  discrete  orthogonal  transforms, 
HT  can  be  extended  to  multiple  dimensions.  For 
example,  the  two  aiirensional  HT,  which  has  been 
U3ed  in  image  processing,  can  oe  defined  as 

«X-1  N2-l  <v,  u> 

Bx(U1’  U2)  =  —2  vx=0  v2=0  X  (V1’  V2,('l) 

(20) 

where 

Bx(ujl,  Ug)  is  the  transform  coefficient, 
x(Vi»  v2)  is  the  sampled  data, 

Vj,  ux  =  0,  1,  Hj -1,  n^^  =  lo,"2'l, , 

v2>  uo  =  °*  11  :i2-1>  n2  ~  -°S2f,2' 

<v,  u>  =  <vlt  Uj^>  +  <Vg,  Ug>, 


<Vl'  ul>  “  m=0  1  ~  1>  2* 

The  terms  v„(m)  and  Uj(m)  are  the  binary  re¬ 
presentations  of  v^  and  u^  respectively,  i.  e.  ,- 

decimal  =  fvl”(nr’>  v1(n1-2)... 

vl(l)  vi^°^binary 

The  inverse  transform  of  (20)  is 

llj  —  i  .'I2-I  <n,  v> 


X  ( V,  ,  v? )'  =  l 


v?/.  ”  ..‘•-a  '^o )  (-1) 

ur0  u2-0  “  121) 

Conclusions 

A  tutorial  exposition  on  Walsh  functions  and 
their  transforms  is  presented.  The  transform 
analysis  based  on  Walsh  functions  amounts  to 
sequency  decomposition  of  a  signal  or  image 
unlike  frequency  decomposition  in  the  case  of 
Fourier  transform.  As  only  add'tions  and  sub¬ 
tractions  are  involved  in  evaluating  the  Hada- 
mard  transform,  savings  in  execution  time  and 
memory  requirements  of  the  digital  computer 
can  be  gained  compared  to  DFT.  however,  the 
HT  power  spectral  points  repre'.ent  groups  of 
sequencies  unlike  the  ir.diviuual  frequency 
representation  in  the  case  of  DFP. 

References 

1.  J.  L.  Walsh,  "A  Closed  Set  of  Orthogonal 
Functions,"  Amer.  J.  of  Mathematics,  vol. 

•*5,  pp.  5-2b ,  1923. 

2.  H.  Ahmed,  .  R.  Rao  and  A.  I>.  Abdussettar, 
"BIFORE  or  Hadamard  Transform,"  IEEE  Trans. 
Audio  and  Electroacoustics,  vol.  «U-19, 

Sept,  1971. 

3.  J.  E.  Whelchel  et  al.  "The  Fast  Fourier- 
Hadamard  Transform  and  Its  Use  in  Signal 
Representation  and  Classification,"  Aero¬ 
space  Electronic  Conference,  SASCON  Record, 
pp.  561-573,  Sept.  9-11,  1968. 

b.  W,  K.  Pratt,  et  al ,  "Hadamard  Transform 

Image  Coding,"  Proc.  IEEE,  vol,  57,  pp.  59- 
68,  Jan.  1969. 

5.  If.  Ahmed  and  K.  R.  Rao,  "Spectral  Analysis 
of  linear  Digital  Systems  Using  BIFORE," 
Electronics  Letters,  vol.  6,  pp.  b 3— Ul* , 

Jan.  22,  1970. 

6.  H.  F.  Harmuth,  "Applications  of  Walsh  Func¬ 
tions  in  Communications,"  IEEE  Spectrum, 
vol.  6,  pp.  82-91,  Hov.  1 969 • 

7.  M.  S.  Corrington,  "Advanced  Analytical  and 
Signel  Processing  Techniques,''  ASTIA  Docu¬ 
ment  No.  AD-2779!*2,  April  1962. 

8.  R.  B.  Lackey,  "So  What's  a  Walsh  Function," 
Proc.  IEEE  Fall  Electronics  Conference,  Oct. 
18-20,  1071,  Chicago,  Ill.,  pn.  368-371. 


9.  D.  M.  Walsh,  "Design  Consider"  tlor.s  for 

Digital  Walsh  filters,"  ibid.,  pp.  372-375. 

10.  »!.  F.  Harmuth,  "Soqueriey  Filters  Based  on 
'..'alsh  Functlo.-.s,"  IK  hr.  Trans  Electromag¬ 
netic  Compati  illity,  vol.  EMC-19,  pp.  ’93- 
295,-  Jane  1968. 

11.  H.  F.  ihimnuth,  "Transmission  of  Infornoticn 
by  Orthogonal  Functions,"  Springcr-Verl-ig, 

II  Printing,  1979. 

12.  T.  S.  iiuan.j,  et  al ,  “Image  Processing," 

Proc.  IKKS,  vol.  5 y,  cp.  1536-1609,  So". 

1971. 

13.  H.  C.  Andrews  and  K.  L.  Caspar! ,  “A  Gene. al¬ 
lied  Technique  for  Spectral  Analysis, "  IKKS 
Trans  Computers,  vol.  C-19,  pp.  l6 -23,  Jan. 
1O70. 

lb.  Proceedings  of  the  D>npos,u.m  on  Applicut:  ns 
of  Walsh  Functions,  March  ii-Ap-ii  b,  19 ' > 
and  April  13-15,  1971,  Washington,  D.  C. , 
Documents  H s  (1970)  AD7071'  U  an  i  .'1971) 
AD727000,  Rational  Technical  Information 
Service,  Operations  Division,  Springfield, 
v’a.  22151." 

13.  P.  b.  Lackey  and  D.  Meltzer,  "A  Simplified 
Definition  of  Walsh  Functions,"  IKSE  Trans. 
Computers,  vol,  C-20,  pp.  211  213,  Fob. 

1971. 

16.  K.  W.  Kenderson,-  "Some  Do„es  on  t>K  Walsn 
Functions."  IEEE  Trans.  Fleet. ror.ic  Comput¬ 
ers,  vol.  EC-13,  pp.  50-5?,  Feb.  196b. 

17.  .1.  Ahmed  ana  R.  !3,  Schultz,  "Position  Spec¬ 
trum  Considerations,"  IEEE  Trar.s,  Audio  tend 
Slectroacous1'*.  "a  vol,  AU-19,  pp.  326-327, 
Dec.  1971. 

Frequency  1  _  _ 


1  fRjL<5> 


R3(t) 

-  n  n  i"M 

-t-l-L,  ll-Lkt 

„  trtrrj  u 

Rb(t) 

1 1 1 1  r  r  r  i 

0 1  til  irl 

_  3  U  u 


Fig.  1,  Podemacher  functions 


Sequence 

0 


Fig.  2.  Walsh 
Functions  and 
Fourier  Harmonics 


Wal  ( 1 ,  t ) 
Wul  (2,  t) 
Wal  (3,  t) 


1  — '~vMal  (4,  t 

0 - , - 

-1  -  Ldf- - - 


,sin  ( 2nt) 


cos  (2 


s  ^2|t-) 


-1  -  — — 

,  ^,-Ual  (6,  t) 


"  „  j  sin  (lint) 

■  pos  (lint)  I — v-- 

~K~  - 

sir.  (6nt) 

cos  (6nt) 

1  '  dl  1*.'“ 


,Wal  (7,  t) 


.  •  V  -  ..:i! 


.jFVsFfc.-Rs 


sin  (Off*.; 
r  vj  \ 


t2  tj 


* 

Walsh  Functions  in  Image  Processin"  and  Two-Dimensional  Filtering 
William  K.  Pratt 

Department  of  Electrical  Engineering 
University  of  Southern  California 


Los  Angeles, 

INTRODUCTION 

The  role  of  Walsh  Functions  in  image 
Processing  and  Two  Dimensional  Filter¬ 
ing  has  been,  appropriately  enough,  binary. 
Walsh  Functions  have  found  useful  appli¬ 
cation  for  image  coding,  image  enhance¬ 
ment,  pattern  recognition,  and  general  two 
dimensional  filtering  [l,4  ].  In  addition, 
the  introduction  of  Walsh  functions  to  these 
applications  has  fostered  new  concepts  of 
generalized  spectral  analysis  and  signal 
representation.  Furthermore,  research 
on  Walsh  functions  has  led  to  a  better 
understanding  of  images  and  their  struc¬ 
ture  than  was  previously  available  from 
purely  sine  wave  analysis. 

Digital  Images 

Before  embarking  on  the  subject  of 
Walsh  function  image  processing,  it  will 
be  fruitful  to  present  some  background  on 
digital  image  processing. 

Imag<  Representation 

A  digital  monochrome  image,  denoted 
as  f(x,  y),  is  defined  here  as  an  array 
(assumed  square  of  dimension  N  by  N  for 
simplicity)  of  samples  of  a  continuous  two 
dimensional  intensity  pattern  of  light. 

Each  picture  element  (pixel)  of  f(x,  y)  is 
assumed  to  be  limited  in  amplitude  to  A 
units  and  linearly  quantized  to  L  levels 
where  L  is  usually  a  binary  number,  i.  e. 

L=2  with  cian  integer.  Since  f(x,  y)  repre¬ 
sents  samples  of  light  intensity,  the  image 
array  must  be  positive.  It  can  be  further 
argued  that  every  intensity  pattern  contains 
at  least  a  few  quanta  of  light.  Hence,  it 
will  be  assumed  that 

0  <f  (x.y)  SA 

In  the  past  few  years  there  has  been  an 
expanding  activity  in  the  processing  of 
digital  color  imagery.  The  discussion  here 
will  be  limited  to  a  consideration  of  digital 
color  images  represented  by  the  three 
primary  color  systems.  In  this  system, 

♦This  research  uas  supported  by  the  Advanced  R< 
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which  is  the  basis  for  color  television  sys¬ 
tems  and  photographic  processes,  the  color 
image  is  described  at  each  coordinate  point 
by  three  arrays  f  ^(x,  y),  f  G(x,  y),  f  R(x,  y) 

that  specify  the  red,  green,  and  blue  tris¬ 
timulus  values  of  an  image  point.  The 
tristimulus  values  designate  the  amounts  of 
red,  green,  and  blue  primary  lights  that  are 
required  to  provide  a  colorimetric  match  of 
a  color  by  a  display  system. 

Image  Processing  Systems 

Figure  1  a  contains  a  block  diagram  of 
a  general  image  processing  system  based 
upon  the  processing  of  the  image  intensity. 
Many  researchers  have  suggested  that 
the  logarithm  of  the  intensity,  which  is 
proportional  to  photographic  density,  should 
be  processed  or  coded  in  a  system,  such 
as  shown  in  figure  lb,  rather  than  the  image 
intensity  [4  ].  The  rationale  behind  this 
suggestion,  indicated  in  figure  lc,  is  that 
the  human  eye  responds  logarithmically  to 
intensity,  and  actually  is  a  linear  system  to 
logarithmic  changes  in  brightness.  The 
performance  of  the  image  "density"  pro¬ 
cessor  has  been  found  to  be  superior  to 
the  image  "intensity"  processor  in  many 
applications.  However,  it  should  be 
remembered  that  both  systems  are  predicated 
upon  an  ideal  sensor  intensity  response  and 
an  ideal  image  intensity  display.  If  the 
sensor  or  display  responds  nonlinearly, 
extreme  image  degradation  may  occur. 

Most  physical  image  sensors  and  displays 
are  inherently  nonlinear  in  intensity,  and 
it  is  necessary  to  compensate  for  the  non¬ 
linearity  either  electrically  or  photographi¬ 
cally  if  precision  image  processing  is  lo 
be  performed. 

Sampling  and  Quantization 

In  the  analysis  of  a  digital  image  pro¬ 
cessing  system,  consideration  should  be 
given  to  the  effects  of  sampling  and  quanti¬ 
zation.  The  two  dimensional  sampling  may 
not  necessarily  be  performed  at  a  suffi¬ 
cient  rate  to  satisfy  the  two  dimensional 
sampling  theorem.  The  implications  of 
processing  an  under  or  over  sampled  image 

isearch  Projects  Agency  of  the  Defense  and  was 

under  Contract  No.  F08606-72-C- 0008. 


^a~gMigssr-js aatBt; 


IMAGE 

SENSOR 


IMAGE 

PROCESSOR 


IMAGE 

DISPLAY 


J  I _ I 

(a)  image  intensity  processor 


(b)  image  density  processor 


0 — @ 
0 — mu 


CONES 


-TO  BRAIN 


(c)  eye  model 

Figure  I .  Image  processing  systems 


are  indeed  serious,  and  can  cloud  the  ex¬ 
pected  processing  results.  II  the  image  is 
under  sampled,  spurious  low  spatial  fre¬ 
quency  components  may  be  unintentionally 
introduced.  On  the  other  hand,  an  over 
sampled  image  contains  redundant  samples 
which  unnecessarily  increase  the  compu- 
ational  load.  Also,  it  should  be  realized 
that  quantization  introduces  a  non-recovcr- 
able  error  in  the  specification  of  the  amp¬ 
litude  of  each  -mage  sample.  The  number 
of  quantization  levels  required  to  maintain 
the  quantization  error  below  the  subjective 
threshold  of  noticeability  is  strongly  depen¬ 
dent  upon  the  characteristics  of  the  image 
sensor  and  display.  It  is  obviously  not 
worthwhile  to  quantize  too  finely  if  the  image 
sensor  is  noisy  or  if  the  image  display  is 
incapable  of  rendering  only  a  few  grey  shades. 
While  the  eye  is  only  capable  of  the  absolute 
discrimination  of  10  to  15  shades  of  grey,  it 
can  detect  the  relative  brightness  between 
two  grey  shades  with  much  greater  sensi¬ 
tivity.  The  effect  of  too  few  quantization 
levels  is  usually  first  noticed  as  gr~y  scale 
contouring  over  regions  of  gradual  shading, 
'cnerally  speaking,  64  quantization  levels 
re  sufficient  for  television  broadcast 
quality  displays.  Up  to  256  quantization 


levels  may  be  required  for  a  high  quality 
mechanical  or  flying  spot  scanner  display. 
These  limits  assume  a  linear  quantization 
of  the  image  intensity. 

Performance  Measures 

In  the  development  of  image  processing 
systems  it  is  highly  useful,  and  often  nece¬ 
ssary,  to  have  some  quantitative  perform¬ 
ance  measures.  The  search  for  a  quanti¬ 
tative  measure  of  image  quality  has  been 
long,  and  unfortuately,  not  particulary 
fruitful.  For  monochrome  imagery  because 
of  its  simplicity,  most  researchers  have 
utilized  the  mean  square  error  between 
an  original  image  f(x,  y)  and  a  processed 
image  f(x,  y)  as  defined  by 

N-l  N-l 

e=  — L  ^  [f(x,  y)-f(x,  y)  ]2  (2) 

N”  x=0  y=0 

where  the  ovorbar  indicates  a  statistical 
overage.  It  has  been  suggested  that  the 
basic  mean  square  error  expression  can  be 
improved  by  taking  into  consideration  the 
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e= 


impulse  response  h(x,  y)  of  the  human  eye 
[5]  .  The  resultant  error  is  given  by 


,  N- 1 
x=0 


N-l 

£ 

y=0 


[f(x,  y)*h(x,  y)-f(x,  y)*h(x,  y)  ] 

(3) 


where  *  indicates  a  spatial  convolution.  It 
is  possible  to  extend  both  of  these  image 
error  measures  to  each  of  the  tristimulus 
arrays  of  a  color  image.  Neither  the 
ordinary  nor  spatial  frequency  weighted 
mean  square  error  expression  has  proven 
to  be  completely  adequate  measure  of 
monochrome  or  color  image  quality;  much 
more  research  effort  is  needed  in  this  area. 


is  the  image  amplitude  probability  distri¬ 
bution. 


Ima^e  Transformation 

The  two  dimensional  Hadamard  trans¬ 
form  F(u,  v)  of  an  image  function  f(x,  y)  can 
be  written  in  series  form  as 

.  N-l  N-l  , 

x=?)  y=0  (5) 

where  q(x,  y,  u,  v)  is  defined  in  [l  ].  It  is 
often  more  convenient  to  express  the  trans¬ 
formation  in  matrix  notation  as 


f* 


! 

! 


I 


1 


i 


For  image  coding  it  is  necessary  to  mea¬ 
sure  the  redundancy  reduction  or  band¬ 
width  compression  obtained  by  a  coding 
process  as  well  as  specify  any  possible 
degradation  in  image  quality.  The  speci¬ 
fication  of  image  coding  performance  should 
be  a  relatively  simple  matter,  but  seems 
to  be  a  subject  of  much  confusion  in  the 
literature.  There  are  two  "compression 
factors"  that  are  often  stated  as  image 
coding  performance  measures: 

sample  number  of  original  image 

reduction  =  samples _ 

factor  number  of  coded  image  samples 

bit  number  of  original  image  code 

reduction  =  bits _ ' _ 

factor  number  of  coded  image  code 

bits 

The  sample  and  bit  reduction  factors  are 
identical  if  the  same  number  of  bits  are 
assigned  to  each  sample.  Both  measures, 
however,  can  be  misleading  since  they  do 
not  indicate  the  "information"  content  of 
the  original  image.  A  high  compression 
factor  can  often  be  obtained  if  the  ori¬ 
ginal  image  is  over-sampled  and  over 
quantized.  The  information  content  of  an 
image  can,  in  theory,  be  measured  by  the 
entropy  of  the  image  source.  But,  in 
general,  the  computation  is  difficult.  An 
estimate  of  the  total  source  entropy  can  be 
obtained  by  performing  a  grey  scale  histo¬ 
gram  of  the  image  and  computing  the  first 
order  entropy  as  given  by 
L 

Hlf(x,y)3  =  -^  P,(k)  log2£P1(k)]  (4) 

Ml 


where 


[F]=  [Hn]  [f][HN3 


(6) 


where  [H^  ]  is  an  Nth  order  real,  sym¬ 
metric,  and  normalized  Hadamard  matrix 
whose  rows  arc  WaJsh  functions.  The 
Hadamard  matrix  [H^jmay  be  obtained  by 
the  construction 


IV=  a 


_ifl  ’] 

[h2]  = 

7211  -ij 

Ph 

H 

N/2 

N/2 

HN/2 

'HN/2 

P 
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where  the  matrix  [p  ]  is  a  permutation 
matr;  that  orders  the  sequencies  of  the 
Walsn  functions.  The  computation  indicated 
by  equation  (6)  is  simply  a  one  dimensional 
Hadamard  transform  of  each  row  of  the  image 
array  and  a  one  dimensional  transform  of 
each  column  of  the  resultant  sei  li-trans- 
forrned  array.  If  the  image  array  is  too 
large  to  be  stored  in  the  computer  then  it 
can  be  placed  in  a  secondary  sequential 
storage  unit  (magnetic  tape  or  disc)  ar.d 
brought  to  the  computer  a  line  at  a  time. 

The  computation  then  proceeds  as  follows: 


[Fj]=  [f][HN] 
[f2Mvt 
[F,]=  [F2)(Hn 
[f].  [r  f 


row  transform 
matrix  transpose 
row  transform 
matrix  transpose 


The  last  matrix  transposition  usually  can 
be  ignored  since  it  is  immaterial  whether 
o.'<»  transforms  the  original  image,  or  its 
transpose.  The  first  matrix  transposition 
can  be  performed  efficiently  by  the  algori¬ 
thm  described  in  reference  [6]. 


P  (k)  =  P  (f{x,  y)  =  kj 
1  r 


Figure  2  contains  photographs  of  two  ori¬ 
ginal  images  and  magnitude  displays  of  the 
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(h)  Hadamard  display  of  girl 


(c)  Original  tank 


(d)  Hadamard  display  of  tank 
Figure  2.  Original  Images  and  transforms 


Hadamard  transforms.  The  images  contain 
256  by  256  pixels  and  64  grey  levels. 

Image  Coding 

The  Hadamard  transform  has  received 
much  attention  for  its  use  in  image  coding 
applications  to  reduce  channel  bandwidth. 

By  itself,  the  transformation  does  not  reduce 
channel  capacity  requirements  because  the 
ransformation  is  information  preserving. 
That  is,  the  entropy  of  the  image  and  the 
ntropy  of  the  transform  of  the  image  are 
identical.  A  reduction  in  the  channel  coding 
requirements,  however,  can  be  obtained  for 
natural  images,  at  the  expense  of  some  aver¬ 
age  distortion,  by  efficiently  coding  the 
Hadamard  transform  domain  coefiicients 
for  transmission.  It  is  important  to  remem¬ 
ber  that  the  transform  domain  coding  process 
will  usually  introduce  some  average  distor¬ 
tion,  and  that  there  is  no  effective  means  of 
limiting  the  peak  distortion.  Thus,  applic¬ 
ation  ot  transform  coding  is  often  limited  to 
image  transmission  systems  for  human 
viewing. 

In  the  transform  coding  process  a  two 
dimensional  Hadamard  transform  is  taken 
over  the  full  size  image  or  some  smaller 
segment  called  a  block.  Next  each  trans¬ 
form  coefficient  is  quantized  and  coded.  At 
the  receiver,  after  decoding,  an  inverse 
transform  is  taken  to  reconstruct  the  image. 
Two  basic  methods  of  transform  domain 
image  coding  have  been  applied.  The  first, 
called  zonal  coding,  entails  the  establish¬ 
ment  of  zones  in  the  transform  domain.  In 
each  ■’one  every  coefficient  is  then  quantized, 
usually  according  to  some  nonlinear  amp¬ 
litude  scale,  and  assigned  a  code  group.  A 
more  efficient  variant  of  zonal  coding  is  to 
assign  an  average  code  length  to  each  zone 
and  use  variable  length  Huffman  coding  of 
the  quantized  samples.  In  either  case,  the 
bit  assignment  is  based  upon  the  assumed 
variance  of  the  transform  domain  samples. 

A  convenient  algorithm,  based  upon  results 
of  rate  distortion  theory,  is  to  select  the 
number  of  bits  according  to  the  relation 

Ngfu.v)  =  In  [o|  (u,v)  3-  In  (p]  (7) 

where  o“  (u,  v)  is  the  variance  of  a  transform 
domain  coefficient  and  D  is  proportional  to 
the  mean  square  error  of  the  coding  process. 
Figure  3  illustrates  a  typical  assignment 
of  code  bits  for  image  coding  in  16  by  16 
pixel  blocks.  The  performance  of  the  trans¬ 
form  zonal  coding  system  can  be  specified 
in  terms  of  the  mean  square  error  between 


17 


the  original  image  and  the  reconstructed 
image  for  a  statistical  class  of  images. 
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Figure  3.  Typical  bit  assignments  for 
transform  coefficients 
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Figure  4.  Mean  square  error  performance 
of  image  transforms 


Figure  4  contains  a  plot  of  mean  square  error 
as  a  function  of  block  size  for  several  image 
transforms.  This  plot  was  obtained  for  an 
image  statistically  described  by  a  Markov 
process.  In  the  coding  process  the  trans¬ 
form  coefficients  are  ranked  according  to 
their  variance.  The  25%  with  the  largest 
variance  arc  coded  with  6  bits  each  and  the 
remainder  are  discarded.  Thus,  the  coding 
requires  an  average  of  1.  5  bits /pixel.  From 
the  diagram  it  is  seen  that  the  Hadamard 
transform  compares  favorably  with  the  other 
transforms,  which  are  more  complicated  to 
implement,  and  provides  a  coding  of  less 
than  1%  mean  square  error  for  reasonably 
small  block  sizes. 

The  second  type  of  Walsh  domain  coding, 
called  threshold  coding,  is  based  upon  the 
establishment  of  a  magnitude  threshold.  If 
the  Walsh  coefficient  is  greater  than  the 
threshold  it  is  quantized  and  coded,  other¬ 
wise  it  is  discarded.  It  is  necessary,  of 
course,  to  code  the  location  of  the  signi¬ 
ficant  coefficients  as  well  as  their  ampli¬ 
tude.  The  performance  of  the  threshold 
coder  is  somewhat  better  than  that  of  the 
zonal  coder,  but  is  more  difficult  to  imple¬ 
ment.  Figure  5  contains  reconstructions 


(a)  Zonal  coding  l.S  bits/pixel 


(b)  Threshold  coding  1.  3  bits  / pixel 
Figure  5.  Examples  of  Hadamard 
monochrome  image  coding. 
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of  images  coded  with  1.5  bits/pixel  for  the 
zonal  and  threshold  coding  processes. 

The  concept  of  two  dimensional  trans¬ 
forms  coding  has  been  extended  to  color 
imagery.  In  this  process  the  red,  green, 
and  blue  tristimulus  signals  are  linearly 
converted  to  the  Y  I  Q  color  coordinate 
system  where  the  Y  signal  represents  the 
image  luminance  and  the  I  and  Q  signals 
jointly  provide  the  hue  and  saturation  infor¬ 
mation  of  a  color.  Figure  6  contains  photo¬ 
graphs  of  the  I  and  Q  color  planes  of  a 
typical  color  image.  The  Y  plane  is  shown 
in  figure  la.  It  is  seen  that  the  10  planes 
do  not  contain  many  high  spatial  frequencies, 
and  hence  can  be  subjected  to  a  high  degree 
of  zonal  coding  without  significant  impair¬ 
ment.  In  a  scries  of  experiments  it  was 
found  that  the  Y  signal  could  be  transform 
coded  with  an  average  of  3.  0  bits/pixel  and 
that  the  I  and  Q  signals  only  required  an 
average  of  0.  3  75  bits /pixel  each  for  a 
total  of  3.5  bits/pixel. 


(b)  Q 

Figure  6.  I  and  Q  tristimulus  planes  of 
a  color  image. 


Two  D i me n signal  Filtering 

The  initial  concept  of  two  dimensional 
Walsh  function  filtering  to  be  developed  here 
is  very  broad  and  generalized.  Basically, 
the  Walsh  functions  are  used  to  perform  a 
spectral  decomposition  of  the  image  into  a 
domain  that  facilitates  the  linear  or  non¬ 
linear  processing  operations.  The  two 
dimensional  filtering  steps  are  indicated 
below: 

f(x,  y>-£F(u,  v)^F(u,  v)-*f$x,  y) 

transform  filter  transform 
process 

Linearity  or  nonlinearity  of  a  filtering  pro¬ 
cess  is  defined  here  by  the  operations 
performed  on  the  Walsh  domain  components, 
not  on  the  spatial  domain  elements  prior  to 
the  forward  transformation  or  after  the 
inverse  transformation. 

Linear  filtering.  In  its  most  general  form 
linear  filtering  may  be  defined  as  a  linear 
combination  of  all  of  the  image  transform 
domain  components  to  produce  a  modified 
transform  domain  as  defined  by 
N-l  N-l 

F(u,  v)~y^  T;  F(u\  v')G(u,u',v,  v‘)  (8) 
u'=0  v'=0 

where  G(u,  u’,v,  v’)  is  the  filter  weighting 
function.  If  the  filter  weighting  function  is 
separable 

G(u,  u',  v,  v')=Gu(u,  u')Gv(v,  v')  (9) 

then  the  filtering  Gyration  can  be  performed 
as  sequential  operations  on  the  rows  and 
columns  of  the  image  transform.  In  this 
case  it  is  convenient  to  switch  to  the  matrix 
representation  of  the  filtering  operation. 

[F>[  Gu][F  ]  [GvJ  (19) 

If  the  f’’ter  matrices  (G  ]or  [G  ]  are 

U  V 

diagonal,  then  the  filtering  operation  reduces 
to  an  individual  weighting  of  the  image  seq- 
uency  components.  In  general  the  optimum 
filter  for  a  particular  application  is  not 
diagonal  since  the  scqucncy  components  are 
correlated. 

Nonlinear  filtering.  In  the  definition  of 
nonlinear  Walsh  domain  filtering  the  only 
restriction  that  applies  is  that  the  filtering 
operation  must  perform  a  mapping  of  F(u,  v) 
into  an  array  F(u,  v)  of  the  same  dimension. 
To  date,  the  only  nonlinear  filtering  functions 
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that  have  received  much  attention  are  the 
logarthmic 

F(u,  v)  =  F(u,  v)1ok£  |  F(u,  v)|} 

|F(u,v)  I  (11) 

and  power  law 

F(u,v)  =  F(u.v)  I  F(u,  v)  ,'a 

|F(u,v)  I  (12) 

functions  where  ais  a  constant.  The  log¬ 
arthmic  Walsh  filtering  operation  is  sim¬ 
ilar  to  the  cepstrum  operation  associated 
with  the  Fourier  transform. 

Image  Restoration  and  Enhancement 

Image  restoration  has  commonly  been 
defined  as  the  reconstruction  of  an  image 
back  to  its  original  form  as  closely  as 
possible.  Typical  restoration  applications 
include  correction  for  defocas  and  image 
motion  blur,  geometric  distoration  com¬ 
pensation,  and  noise  filtering.  Image 
enhancement  entails  operations  that 
improve  the  appearance  of  an  image  to  a 
human  viewer.  Several  examples  of  the 
application  of  Walsh  functions  to  image 
restoration  and  enhancement  are  given 
below. 

Noise  reduction  a  frequently  encountered 
image  processing  problem  is  the  reduction 
of  the  visual  effects  of  image  noise  generated 
by  the  sensor,  processing  system,  or  display. 
Consider  a  "noisy''  image,  f(x,  y),  composed 
of  additive  signal,  s(x,  y),  and  noise,  n(x,  y), 
components. 

f(x,  y)  =  =  (x,  y)+n(x,  y)  (13) 


of  great  importance  to  note  that  the  minimum 
mean  square  error  obtained  with  Hadamard 
transform  filtering  is  the  same  as  could  he 
obtained  with  the  Fourier  or  Karhunen- 
Loeve  transforms  or  any  other  unitary  trans¬ 
formation.  The  potential  advantage  of  using  the 
the  Hadamard  transform  is  the  reduced  amount 
of  computation  required  as  compared  to  many 
other  transforms.  Figure  7  contains  displays 
of  a  Markov  process  covariance  matrix  for 
a  vector  length  of  sixteen  and  the  corres¬ 
ponding  optimum  Hadamard  Wiener  filter 
matrix.  It  is  possible  to  reduce  the  com¬ 
putational  requirements  even  further  by 
taking  advantage  of  the  character  of  the 
filter  matrices.  In  many  applications  it 
will  be  found  that  the  optimum  filter  matrices 
contain  many  near  zero  elements.  If  a 
filter  element  is  very  small  it  can  simply  be 
discarded  from  the  computation.  It  has 
been  found  that  up  to  90%  of  the  filtering 
multiplications  can  be  avoided  in  this  manner 
with  only  a  slight  increase  in  error  for 
many  applications. 
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T'  e  optimum  filter  to  minimize  the  mean 
square  error  between  the  signal  image 
s(x,  y)  and  me  filtered  image  f(x,  y)  is 
obtained  from  an  extension  of  classical 
Wiene*  filter  theory  [7]  .  For  the  special, 
but  practical,  case  of  the  signal  and  noise 
uncorrelated  »vith  each  other,  and  separate 
processing  of  the  rows  and  columns  of  the 
image,  the  optimum  filter  matrices  are 
found  to  be 

[G  ]  =[H][C  JC  +  C  f1  [H  ]  (14) 

*•  u  opt  sx  sx  nx 

[G  3  =[HjC  IC  *  C  ]~l[H]  (15) 

w  v  opt  sy  sy  ny 

where  [C  3,  [C  3,  [c  3,  Jc  3  are 
the  covarfance  matrices  oF\he  elements 
along  the  rows  and  columns  of  the  signal 
and  noise  arrays,  respectively.  It  is  also 


Figure  7.  Display  of  Hadamard  Wiener 
filter  for  N=16  and  Markov 
process  signal  with  R=0.  9 

Figure  8  shows  an  example  of  Walsh 
domain  Wiener  filtering. 

Inverse  filtering.  In  many  imaging  systems 
an  observable  image  can  be  considered  as 
the  output  of  a  linear,  shift  invariant  two 
dimensional  system  with  an  impulse  response 
h  ,(x,  y)  that  mod  ;ls  the  degrading  mechanism 
of  the  imaging  system.  Thus,  the  degraded 
image  is  given  by 

fd(x»  y)=f(x»  y)*hd(x,  y)  (16) 

By  the'^tmvolufion  theorem  of  Fourier 
transform  theory 
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(a)  Tank,  plus  noise 


(b)  Hadamard  Wiener  filtering 


(c)  Selective  computation  Hadamard 
Wier.er  filtering 

Figure  8.  Example  of  Walsh  domain  Wiener 
filtering 


<yd<u.v)=SKv)ftdKv>  <i7> 


where  the  script  letters  indicate  the  two 
dimensional  Fourier  transforms  of  the 
degraded  image,  original  image,  and 
imaging  system  transfer  function,  respecti¬ 
vely.  If  the  Fourier  spectrum  is  multiplied 
point  by  point  with  the  transfer  function 
1  /9^{u,  v),  the  result  is  the  original  image 
Fourier  spectrum,  which  can  be  inverse 
Fourier  transformed  to  obtain  the  original 
image.  This  process  of  inverse  Fourier  image 
reconstruction  is  exact  in  theory,  but  often 
fails  in  practice  because  of  the  inversion 


of  the  zeros  of^i^(u,  v)  and  amplication 
of  high  frequency  image  noise.  An  exact 
analog  of  Fourier  inverse  filtering  does 
not  exist  for  Walsh  function  because  of  the 
lack  of  an  equivalent  "Walsh  convolution 
theorem"  as  represented  by  eqs  (16)  and  (17). 
It  is  possible,  however,  to  achieve  some 
improvement  in  image  quality  by  a  form 
of  Walsh  domain  inverse  filtering  in  which 
the  magnitude  of  the  Fourier  inverse  filter 
is  used  as  an  inverse  filter  for  the  Walsh 
spectrum  of  an  image.  Reference  8  gives 
an  example  of  Walsh  domain  inverse  filter¬ 
ing. 


Summary 

When  evaluating  the  usefulness  of  Walsh 
functions  for  image  processing,  one  is 
led  to  the  question:  Do  Walsh  functions 
possess  any  properties  inherently  useful 
for  image  processing?  The  answer  i3 
equivocal.  Walsh  functions  do  not  chara¬ 
cterize  an  image  particulary  well;  they  do 
not  "resemble"  typical  image  lines.  From 
this  standpoint  there  is  no  reason  to  preier 
Walsh  functions  overy  any  other  functions 
with  a  property  of  spectral  decomposition. 

The  major  potential  advantage  of  Walsh 
functions  in  image  processing  is  their 
relatively  simple  computability.  This  is  a 
major  factor  of  consideration  for  the  pro¬ 
cessing  of  pictures  with  millions  of  elements. 

The  future  role  of  Walsh  functions  in 
image  processing  is  uncertain  to  this 
observer.  In  image  coding  Hadamard 
transform  coders  may  find  practical  use 
in  specialized  applications  in  which  a  small 
amound  of  image  degradation  is  permitted, 
but  the  coder  must  be  relatively  simple. 

For  the  computer  processing  of  images 
for  restoration  purposes,  the  Walsh  functions 
hold  promise.  But,  as  mentioned  e'arlier, 
perhaps  the  greatest  benefit  to  the  field 
of  image  processing  to  be  derived  from 
the  introduction  of  Walsh  functions  is  that 
they  have  stimulated  research  into  new 
concepts  of  generalized  spectral  analysis, 
and  have  brought  into  deeper  consideration 
the  comprises  of  processing  performance 
and  computation  requirements. 
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Abstract 


Electromagnetic  v.-aves  used  in  communi¬ 
cations  arc  predominantly  sinusoidal  waves. 
This  should  not  lead  one  to  believe  that  sinu¬ 
soidal  waves  are  the  only  possible  or  useful 
ones.  It  is  shown  how  an  optical  spectrometer 
would  have  to  be  constructed  to  decompose 
light  into  Walsh  functions,  that  such  a  spect¬ 
rometer  would  yield  more  information  than 
the  usual  spectrometer  showing  the  frequency 
power  spectrum,  but  that  extremely  fast  time 
variable  shutters  would  be  needed  for  its 
implementation.  Electromagnetic  Waish 
waves  of  interest  in  communications,  on  the 
other  hand,  require  switches  with  transient 
times  of  about  1  nanosecond,  which  is  within 
the  state  of  the  art.  Antennas,  generated 
field  strengths,  quadrepolc  radiation,  an 
interference  effect  and  the  Doppler  effect  are 
discussed  in  a  nonmathematicaf  way. 

INTRODUCTION 

It  is  frequently  believed  that  an  electro¬ 
magnetic  wave  must  have  an  electric  and 
magnetic  field  strength  that  vary  with  time 
like  a  sinusoidal  function.  Actually  the  gener¬ 
ation  of  sinusoidal  waves  is  a  considerable 
technological  feat.  Heinrich  Hertz  never 
succeeded  <n  producing  anything  close  to  a 
sinusoidal  wave.  His  experiments  with  wave 
propagation  were  done  with  what  we  would 
call  colored  noise  today.  The  generation  of 
reasonably  sinusoidal  waves  was  a  vexing 
problem  for  some  twenty  years  following 
Hertz's  experiments,  and  it  was  not  solved 
satisfactorily  until  the  invention  of  the  elec¬ 
tronic  tube.  Anybody  working  with  fast 
switching  circuits  knows  that  the  problem  is 
not  how  to  produce  norrsinusoidal  waves  but 
how  not  to  produce  them.  Indeed  we  cannot 
switch  an  electric  lamp  on  or  off  without 
generating  nonsinusoidal  waves. 

Visible  light  is  a  form  of  electromagnetic 
waves  for  which  the  sinusoidal  time  variation 
is  often  believed  to  have  been  proved  by  inter¬ 
ference  experiments.  This  is  not  so.  Let  us 
investigate  in  some  detail  what  interference 
experiments  prove. 


#  The  author  wants  to  thank  the  International 
Telephone  and  Telegraph  Corporation,  Electro- 
Physics  Laboratories  for  the  financial  support 
cf  his  work. 
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X*dsma  first  irommum.  X-  2d  ;ina  first  mir»mu<n 


Figure  1.  Linear,  time  invariant  diffraction 
? rating  with  fixed  light  source  and  movable 
oetccter  (a),  and  with  fixed  detecter  and 
movable  light  source  (b). 

Figure  la  shows  a  diffraction  grating 
with  eight  transparent  slots  at  a  distance  d. 

A  sinusoidal  wave  with  wavelength  \  coming 
from  the  left  produces  eight  spherical  waves 
on  the  right  side  of  the  grating.  The  waves 
add  up  for  the  angle  <1=0,  they  cancel  to 
yield  a  first  minimum  for  sin  a  =  \/2d  ,  they 
add  again  to  yield  »he  first  maximum  for 
sin  a  -  X/d,  and  so  forth. 


If  a  sum  of  sinusoidal  waves 
X*.  sin  (2  Tt  c  t  /Xj  +  (}j)  is  received  from 
the  left  one  obtains  minima  and  maxima  for 
each  wave.  This  means  that  the  incident 
light  signal  is  decomposed  into  sinusoidal 
functions.  Since  we  know  from  Fourier 
analysis  that  almost  any  signal  can  be  decom¬ 
posed  into  sinusoidal  functions,  the  pattern 
of  minima  and  maxima  produced  by  the 
diffraction  grating  will  prove  to  us  that  this 
device  has  the  necessary  features  to  actually 
perform  such  a  decomposition.  In  other 
words,  the  diffraction  pattern  proves  that 
the  diffraction  grating  is  a  linear,  time 
invariant  device.  One  will  suspect  that  a 
time  variable  diffraction  grating  will  decom¬ 
pose  light  into  some  other  system  of  functions. 

DECOMPOSITION  OF  LIGHT 
INTO  WALSH  FUNCTIONS 


Figure  lb  shows  a  modification  of  the 
diffraction  grating  of  Figure  la.  The  detector 
observes  the  light  emitted  vertically  to  the 
grating  while  the  light  source  is  moved  to 
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provide  angles  of  incidence  from  <1  =  0  to  could  be  implemented  and  let  us  find  the  rule 

a  =  90°.  In  Figure  la,  on  the  other  hand,  for  their  operation, 

the  detecter  has  to  be  moved  while  the  light 
source  is  fixed. 


SQK4.I/T)  sq!  ( 3,t/T) 


Figure  3.  Operation  of  the  shutters  SI  to 
Figure  2.  Linear,  time  variable  diffraction  S8  for  passage  of  the  waves  sal(4,  t  T)  and 

grating  with  fixed  detector.  The  time  varia-  sal(3,  t/T);  black:  shuiter  closed,  white: 

tion  is  provided  by  on-off  shutters  SI  to  S8.  shutter  open.  The  amplitude  samples  shown 

by  a  heavy  line  illustrate  the  delay  between 
Figure  2  shows  how  the  diffraction  grating  the  eight  waves, 

of  Figure  lb  Ids  to  be  changed  to  decompose 

light  into  Walsh  waves.  The  Walsh  functions  Figure  3  shows  the  operation  of  the 

have  the  parameters  time  base  T  and  se-  shutters  SI  to  S8  to  permit  a  Walsh  wave 

quency  >p  which  are  significant  for  our  sal(4,t/T)  to  pass.  The  lines  1  to  8  show 

purpose,  while  only  the  frequency  or  wave-  the  function  represented  by  samples  with 

length  was  important  for  sinusoidal  functions.  time  shifts  0,  T/8,  2T/8,...  7T/8.  These 

The  time  base  is  determined  by  choosing  the  time  shifts  correspond  to  the  arrival  of  such 

angle  of  incidence  a.  If  the  diffraction  a  wave  at  the  eight  transparent  slots  in 

grating  has  e1  >. «  .  slots  with  distance  d  one  Figure  2.  The  shutters  SI  to  S8  are  open 

has  to  choo.  c  a  according  to  the  formula  (white)  or  closed  (black)  as  shown.  One  may 

see  that  there  are  always  four  positive 

cT  =  7dsina  ,  (I)  samples  of  the  Walsh  wave  that  are  super¬ 

imposed  by  the  properly  opened  shutters 

where  c  is  the  velocity  of  light.  In  the  while  the  negative  samples  are  blocked.  One 

general  case  of  2n  slots  one  has  to  substitute  may  readily  see  that  the  opening  of  the  shutter 

2n-l  for  7.  SI  coincides  with  the  four  positive  samples  of 

sal(4,  t/T)  in  Figure  3a  and  with  those  of 

The  Walsh  functions  sal(i,t/T)  and  sal(3,t/T)  in  Figure  3b.  The  opening  times 

cal(i,t/T)  with  time  base  T  but  various  of  the  shutters  S 2  to  S8  are  obtained  from 

normalized  sequences  i  are  separated  by  a  cyclical  shift  of  the  opening  times  of  the 

making  the  transparent  slots  of  the  diffrac-  shutter  SI. 

tion  grating  time  variable.  In  the  case  of  the 

Walsh  functions  this  time  variation  is  pro-  Figure  4a  shows  the  shutters  operated 

vided  by  on-ofl  shutters  SI  to  S8  that  are  for  passage  of  sal(3,t/T)  but  the  function 

either  open  or  closed.  For  other  systems  sal(4,  t/T)  is  applied.  Two  positive  and  two 

of  functions  one  would  generally  need  a  more  negative  samples  are  passed  through  the 

complicated  form  of  time  variation.  Let  us  diffraction  grating  at  any  time  and  their  sum 

ignore  for  the  moment  how  such  shutters  yields  zero.  Figure  4b  shows  the  shutters 
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in  heavy  line  are  passed  all  the  others  cancel 
by  interference.  Note  that  the  constant  function 
wal(0,9)  -  wal(0,'./T)  is  always  passed  in 
addition  to  the  desired  function.  A  short 
reflection  of  Figure  I  shows  that  the  same 
holds  true  for  a  time  invariant  diffraction 
grating  -  out  there  is  no  light  wave  with 
frequency  or  sequent  y  zero 

To  obtain  an  estimate  for  the  operating 
times  of  the  shutters  let  us  reflect  that  the 
frequency  of  visible  light  lies  between  4xl0^‘* 
and  8x)0l"f  Hz.  This  tails  for  switching  times 
in  the  order  of  10'l^s  or  less  to  permit  the 
use  of  the  sampled  amplitude  representation 
of  Walsh  functions  as  shown  in  Figures  3  to 
5.  One  cannot  rule  out  that  this  will  eventually 
be  possible  but  presently  known  effects  for  the 
implementation  of  shutters,  such  as  the  Kerr 
effect,  are  some  5  to  6  orders  of  magnitude 
slower.  An  obvious  advantage  of  time  variable- 
spectrometers  would  be  that  they  would  not  only 
show  the  relative  power  of  different  spectral 
lines  but  also  uncover  a  relationship  between 
the  times  of  emission. 


Figure  4.  (a)  Shutters  SI  to  S8  operating  to 

pass  sal(3,t/T)  block  sal(4,t/T.  (b)  Shutters 
operating  to  pass  sal(4,t/T)  block  sal(S,t/T). 

operated  for  passage  of  sal(4,t/T)  but 
sal(3,t/T)  is  applied.  Again  the  waves  cancel 
at  all  times. 
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WALSH  SHAPED  RADIO  WAVES 

Having  shown  that  electromagnetic  waves 
are  not  necessarily  sinusoidal  the  engineer  is 
faced  with  the  task  of  showing  that  something 
useful  can  be  done  with  nonsinusoidal  waves. 

So  far  the  investigation  of  nonsinusoidal 
electromagnetic  waves  has  been  restricted 
essentially  to  Walsh  waves.  Four  basic 
differences  between  .Vaish  and  sinusoidal 
functions  have  been  found  that  might  be 
turned  into  useful  applications: 

a)  The  technology  for  the  implementation  of 
equipment  is  ditfe.ent. 

b)  The  differentiation  of  a  sinusoidal  function 
yields  the  same  function  except  for  a  changed 
amplitude  and  phase,  while  the  differentiation 
of  a  Walsh  function  yields  a  lifferently  shaped 
function. 

c)  The  sum  of  several  sinusoidal  functions 
with  arbitrary  amplitudes  and  phas  s  but  equal 
frequency  yields  a  sinusoidal  function  with 

the  same  frequency.  This  is  the  basis  for 
interference:  effects.  Walsh  functions  arc- 
summed  differently  and  their  interference 
effects  are  thus  different 


Figure  5.  Operation  of  the  shutters  SI  to 
S8  in  Figure  2  for  separation  of  the  first 
eight  Walsh  functions. 

Figure  5  shows  the  operation  of  the 
shutters  SI  to  S8  for  separation  of  the  first 
eight  Walsh  functions.  The  functions  shown 


d)  The  Doppler  effect  can  transform  a  sinu¬ 
soidal  function  into  another  for  any  velocity 
ratio  v/c  while  a  ratio  v/c  -  3/5  or  more  is 
required  to  transform  a  Walsh  function  into 
another  one  of  the  same  system. 

Let  us  look  at  examples  of  these  effects. 
Figure  6  shows  a  radiator  for  Walsh  waves 
implemented  by  four  Hertzian  magnetic 
dipoles.  Currents  will  flow  clockwise  in  the 
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Figure  6.  Array  of  four  Hertzian  magnetic 
dipoles. 


loops  shown  by  dashed  linos  if  the  function 
wal(j,9)  has  a  positive  value.  A  negative 
value  of  wal(j,8)  will  cause  currents  to  tlow 
counter  clockwise  in  the  loops  shown  by 
dashed  lines.  Tile  diameter  of  the  loops  is 
small  compared  with  cT,  where  T  is  the 
lime  base  of  the  Walsh  fun.  tion  wal(j.O)  - 
wal(j,  t/T). 


The  time  variation  of  the  electric  and 
magnetic  field  strengths  produced  by  a 
Hertzian  magnetic  dipole  are  shown  in 
Figure  7.  The  first  line  shows  the  idea¬ 
lized  current  i(t)  -  Ical(3,t/T)  flowing  in 
the  dipole.  E(l/r-2,t)  is  a  component  of 
the  electric  field  strength  declining  pro¬ 
portionate  to  l/r2,  which  is  the  near  zone 
component.  The  far  zone  component  de¬ 
clining  proportionate-  to  I/ris  represented 
by  E(l/r,t)  The  magnetic  field  strength 
consists  of  the  three  components 
H(l/r3,t),  H(1  /  r2,  t)  and  H  ( 1  /  r.  t)  whi.  h 

decline  proportionate  to  l^rf,  1  •  r-  and  1/r. 


The  time  variation  of  the  far  zone- 
components  E(l/r,t)and  H(  1  /r,  t)  is  the 
first  derivative  of  the  dipole  current  i(t). 

The  components  E(i/r2,t)and  H(l-'r2,t) 
vary  like  the  current  i(t;,  and  the  compo¬ 
nent  H  ( 1  /r3,  t)  \  a  ries  lize  the  integral  of 
the  current  i(t).  These  relations  between 
the  time  variation  of  the  dipole  turren>  i ( t ) 
and  the  components  of  the  elect  -it  and 
magnetic  field  strengths  hold  true  (or  any 
current  i(t).  If  i(t)  varies  like  a  sinusoidal 
functions  its  derivative  and  its  integral  will 
vary  like  i(t)  except  for  phase  shifts.  H>  nee. 
the  near  and  far  zone  components  of  sinusoi¬ 
dal  waves  are  hard  to  separate  while  those 
of  Walsh  waves  can  be  much  more  :eadily 
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Figure  7.  Time  variation  of  the  antenna 
current  i/t  in  a  Hertzian  magnetic  dipole  and 
the  tin.,  variations  of  the  produced  ol.-ctric 
and  magnetic  field  strengths  declining 
proportionate  to  1/r,  l/r2and  1  / r ^ . 


separated  due  to  their  different  shape.  Ii 
one-  can  sepa  rate  E(!/r,  t)  and  E(l/r2,t) 
one  may  compare  their  power  and  derive  the 
distance  of  the  receiver.  One  interesting 
aspect  of  this  passive  distance  measuring 
effect  is  that  one  might  be  able  to  obtain  a 
signal-to-noise  power  ratio  that  decreases 
like  1/r*  while  the-  active  distance  measure¬ 
ment  by  the  radar  pYIncfple  yields  a  signal- 
to-noise  power  ratio  that  dec  reases  like 
l/H.  However,  the  radar  principle  permits 
a  much  higher  accuracy  of  distance  measure¬ 
ment. 


iCQl(3.t/l) 


i(t)=I  cal(3.t/T,  AT/T) 


Figure  8  Walsh  shaped  antenna  current  i(t) 
with  a  finite  rise  time  AT  and  its  first 
derivative  di(’)/dt. 


Figure  8  shows  the  idealized  antenna 
current  1  c  a  1  (  i .  t  T)  replaced  by  a  mot,- 
realistic  current  i(0  with  a  swit.hing  time 
AT  !  com  -t  to  -I  or  from  -I  to  -I.  ’  he¬ 

ars1  derivative-  consists  of  rec'angular  pulses 
of  duration  1  and  magnitude  21 ,  A  T  When 
AT  approach.es  zero  one  obtains  the  Di-ac 


K>‘ 


pul3cs  of  Figure  7.  The  energy  of  ?  rectangu¬ 
lar  pul3e  is  proportionate  to  (21/  AIJ^AT  = 
412/AT.  Hence,  the  average  power  of  the 
electric  and  magnetic  field  strength  in  tne 
far  zone  canno„t  only  be  increased  by  a  larger 
amplitude  I  of  the  antenna  current  but  also  by 
a  shorter  switching  time  AT.  This  indicates 
that  a  small  antenna  can  radiate  a  large 
average  power. 


focal  point.  A  two-dimensional  array  accord¬ 
ing  to  Figure  9  and  even  more  so  its  exten¬ 
sion  to  a  three-dimensional  array  will  come 
closer  to  a  point-like  radiator  than  the  one- 
dimensional  array  of  Figure  6  or  the  one¬ 
dimensional  resonant  dipole  used  for  sinu¬ 
soidal  radiation.  This  is  a  second  incentive 
for  the  development  of  two-  and  three- 
dimensional  radiators. 


Figure  9.  Two-dimensional  array  of  16 
Hertzian  magnetic  dipoles. 


QUADRUPOLE  RADIATION 

Sinusoidal  waves  in  free  space  are 
generally  dipole  waves.  The  main  reason 
seems  to  be  that  quadrupole  and  higher  order 
multipole  waves  are  radiated  with  less  power 
by  a  radiator  of  fixed  size.  This  is  not  so 
for  Walsh  waves. 
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Figure  9  shows  an  array  of  16  Hertzian 
magnetic  dipoles.  They  are  arranged  ip  a 
two-dimensional  pattern.  Let  us  observe 
that  the  power  radiated  by  n  interacting 
dipoles  is  n^  times  the  power  radiated  by  one 
dipole  and  that  the  power  radiated  by  one 
dipole  increases  proportionate  to  n.  There 
is  thus  a  great  incentive  to  use  many  inter¬ 
acting  dipoles.  To  maxe  the  dipoles  inter¬ 
acting  they  must  not  be  spaced  too  far  apart; 
more  precisely,  if  the  distance  between  two 
dipoles  is  d  it  will  take  the  time  d/c  for  a 
change  of  current  in  one  dipoxc  to  affect  the 
current  flowing  in  the  oilier.  Obviously  we 
can  have  more  Hertzian  dipoles  close  toge¬ 
ther  if  they  are  arranged  in  a  two-dimens¬ 
ional  array  rather  than  in  a  one-dimensional 
anay  as  in  Figure  6.  Even  more  desirable 
is  an  extension  of  the  radiator  of  Figure  9 
to  a  three-dimensional  array. 

Antennas  for  sinusoidal  waves  are  usually 
one-dimensional.  The  typical  resonant 
dipole  is  long  in  one  space  dimension  and  has 
virtually  no  extension  in  the  two  other  space 
dimensions.  One  could  of  course  use  the 
antennas  of  Figures  6  and  9  to  radiate  sinu¬ 
soidal  waves  but  the  generators  delivering 
the  currents  to  the  Hertzian  magnetic  dipoles 
could  no  longer  be  simple  switches  but  would 
have  to  be  amplifiers  for  sinusoidal  currents. 


Figure  10.  Classification  of  dipoles, 
quadrupoles  and  multipoles  by  two-dimension¬ 
al  Walsh  functions  wal(k,  x)wal(m,  y);  k,  m  = 

0,  1,2. 

Figure  10  shows  on  the  left  vertically 
and  horizontally  polarized  dipoles  denoted 
"dipole  21"  and  "dipole  22".  Furthermore, 
there  are  three  quadrupoles  denoted  41  to 
43.  Tne  right  side  of  Figure  10  shows  two- 
dimensional  Walsh  functions.  The  black  areas 
represent  the  value  +1,  the  white  areas  the 
valve  -1.  One  may  readily  see  that  the 
poritive  and  negative  signs  of  the  dipoles 
on  the  left  correspond  to  the  positive  and 
negative  signs  of  the  two-dimensional  Walsh 
'.unctions.  This  correspondence  greatly 
simplifies  a  discussion  of  radiation  modes. 

For  instance,  it  is  obvious  from  Figure  10 
that  there  is  no  "unipole"  corresponding  to 
the  all  black  function  wal(0,  x)wal(0,  y). 

Unipole  radiation  does  not  exist  for  electro¬ 
magnetic  waves  due  to  the  preservation  of 
charge  but  it  is  the  major  mode  of  radiation 
of  acoustic  waves. 

According  to  Figure  10  a  quadrupole  41 
consists  of  two  dipoles  fed  with  currents 
flowing  in  the  opposite  direction.  Two  such 
electric  Hertzian  dipoles  are  shown  in  detail 
in  Figure  11.  The  electric  and  magnetic 
field  strengths  in  the  far  zone,  declining 
proportionate  to  1 /r,  vary  with  time  like  the 
second  derivative  of  the  current  flowing  in 


Consider  a  transmitting  antenna  consisting 
of  a  parabolic  reflector  and  a  radiator  at  its 


dipole  2 


Figure  11.  Hertzian  electric  quadrupole  41. 


the  dipoles.  The  resulting  time  variation 
is  shown  in  Figure  12.  On  top  is  the  nominal 
dipole  current  I  cal(3,t/T).  The  second  line 
shows  the  more  realistic  current  with  finite 
transient  time  between  +1  and  -I;  furthermore, 
the  transients  arc  rounded  while  those  in 
Figure  8  had  sharp  breaks.  As  a  result  the 
first  derivative  shown  in  line  3  consists  of 
trapezoidal  rather  than  rectangular  pulses  of 
width  AT.  The  second  derivative  consists  of 
pairs  of  rectangular  pulses  of  width  £AT. 

The  energy  of  a  rectangular  pulse  is  pro¬ 
portionate  to 

[ 21/ e(A T)2]  2  AT  =  4I2/E2(  AT)3.  Hence, 


the  average  power  of  the  electric  and  mag¬ 
netic  field  strength  in  the  far  zone  increases 
faster  with  decreasing  switching  time  than 
for  dipole  radiation.  This  means  that  it  is 
theoretically  possible  to  radiate  more  power 
in  the  quadrupole  mode  than  in  the  dipole 
mode  for  an  antenna  of  given  size  if  one 
succeeds  in  decreasing  the  switching  time 
sufficiently.  The  different  time  variation 
oi  the  electric  and  magnetic  field  strengths 
r  dipole  and  quadrupole  radiation  indicates 
that  interference  effects  will  be  different. 
Generally  speaking,  interference  effects  of 
quadrupole  radiation  yield  a  better  resolution 
than  interference  effects  of  dipole  radiation, 
and  this  holds  even  more  so  for  higher  order 
multipole  radiation. 


INTERFERENCE  EFFECTS, 
DOPPLER  EFFECT 


Figure  13  shows  as  an  example  of  an 
interference  effect  the  reflection  ot  a  sinusoi¬ 
dal  radar  pulse  from  two  point- like  targets 
B1  and  B2.  The  reflected  pulses  are  shown 
in  lines  a  and  b.  Line  c  shows  their  sum, 
which  is  the  signal  received  by  the  radar. 
Except  for  the  bulges  of  duration  2(d2-d,)/c 
at  the  beginning  and  end  ol  the  signal  the  re 
is  nothing  that  indicates  that  this  signal  was 
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Figure  12.  Time  plots  for  quadrupole 
radiation.  (1)  nominal  antenna  current; 

(2)  realistic  antenna  current;  (3)  first 
derivative  cf  the  antenna  current;  (4)  second 
derivative  of  the  antenna  current  or  time 
variation  of  the  electric  and  magnetic  field 
strength  in  ihc  fai  zone. 


caused  by  two  targets  rather  than  by  a  single 
larger  target.  A  typical  radar  pulse  will 
contain  about  1000  carrier  cycles,  hence  the 
relative  energy  of  the  bulges  at  the  end  is 
very  small. 
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Figure  13.  Example  of  an  interfe rence 
effect  of  sinusoidal  and  Walsh  shaped  waves. 
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Let  a  Walsh  wave  in  dipole  mode  be 
reflected  by  the  two  targets.  The  far  zone 
components  of  the  electric  and  magnetic 
field  strengths  consist  of  narrow  vectangular 
pulses.  The  pulses  reflected  from  B1  are 
shown  in  line  d  and  those  reflected  from  82 
are  shown  in  line  f.  The  difference  between  a 
reflection  from  two  small  targets  or  ore 
larger  target  is  no  longer  represented  by 
low  energy  effects  at  beginning  and  end  of  a 
radar  pulse.Indeed,  even  a  periodic  Walsh 
wave  would  distinguish  between  one  and  two 
ta  rgets. 
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Figure  14.  Doppler  effect  for  sinusoidal 
and  Walsh  shaped  waves:  (a)  functions 
generated  and  observed  in  the  same  system 
of  reference;  (b)  functions  observed  in  a 
system  moving  away  with  velocity  -v/c  = 
5/13. 


Figure  14a  shows  three  Walsh  and  three 
sine  functions  as  observed  in  a  system  of 
reference  that  has  no  relative  velocity  to  the 
system  of  reference  in  which  they  are  get 
erated.  Figure  14b  shows  the  observed 
functions  if  the  system  in  which  they  are 
generated  moves  away  with  velocity  -v/c  = 
5/13.  An  observer  cannot  tell  whether 
the  observed  sine  function  sin  2rt(6f/3)t  was 
produced  by  a  transmitter  without  •  -lative 
velocity  radiating  the  function  sir  2  ;2f)t 

or  one  with  relat.ve  velocity  -v,  5  '13 

radiating  the  function  sin  2tt(3f)i.  In  the 
case  of  the  Walsh  function  there  is  no  diffi¬ 
culty  telling  that  sal(3,t/T')  in  Figure  14b 
was  caused  by  sal(3,t/T)  in  Figure  14a  and 
not  by  sal(2,t/T).  The  same  applies  to  the 


first  or  second  derivatives  of  the  Walsh 
functions. 


If  transmitter  and  receiver  move  away 
from  each  other  the  relative  velocity  must 
be  at  least  -v/c  =  3/5,  if  they  approach  each 


other  it  must  be  at  least  +v'c  =  3/5  before 


29 


a  Walsh  function  with  known  time  base  T 
is  transformer  into  another.  There  are 
no  such  minimum  velocities  for  sinusoidal 
functions. 
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Walsh  Functions  have  been  very  useful  in 
transform  spectroscopy  as  evidenced  by  the  recent 
work  in  Radanard  transform  spectroscopy.  It  is 
also  possible  to  use  Walsh  functions  to  generate 
a  suitable  grille  for  use  in  grille  spectroscopy 
as  developed  by  Girard.  The  hyperbolic  grill 
that  is  often  used  in  this  technique  is  very 
closely  related  to  the  grill  whose  transmittance 
is  defined  by  a  complete  set  of  the  sal  func¬ 
tions.  This  paper  explores  this  relationship 
and  indicates  how  other  grilles  of  specified 
properties  may  be  generated.  Thus ,  the  applica¬ 
tion  of  Walsh  functions  can  be  profitably  ex¬ 
tended  to  the  domain  of  the  grille  spectrometer. 

Introduction 

The  purpose  of  this  paper  Is  to  explore  how 
Walsh  functions  may  be  effectively  employed  to 
greatly  Improve  the  performance  of  grating 
spectrometers  by  using  Walsh  functions  patterned 
grilles  (masks)  to  Increase  the  light  throughput 
and  to  multiplex  the  various  wavelengths  to  be 
examined.  A  typical  grating  spectrometer  Is 
Illustrated  In  Figure  1  and  may  be  schematically 
diagramed  as  shown  in  Figure  2.  The  function  of 
the  grating  Is  to  produce  an  angular  deviation 
of  the  light  beam  Impinging  upon  It  In  propor¬ 
tion  to  the  wavelength  of  the  light. 

The  original  light  beam  is  defined  by  the 
entrance  mask  and  collimated  by  the  mirror  be¬ 
fore  falling  on  the  grating.  The  angle  at  which 
the  light  Is  reflected  from  the  grating  is  a 
function  of  wavelength.  This  beam  is  focused  by 
the  mirror  onto  the  output  mask.  A  detector 
behind  this  mask  then  converts  the  light  to  an 
electrical  signal  for  recording. 

The  sensitivity  of  the  spectrometer  Is  a 
measure  of  the  weakest  light  signal  It  can  de¬ 
tect  and  Is  a  function  of  the  effective  area  and 
solid  angle  ovei"  which  light  may  be  gathered 
(throughput)  and  the  noise  level  of  the  detector 
employed.  The  throughput  of  a  conventional 
spectrometer  is  proportional  to  several  Instru¬ 
ment  parameters. 

"  V'* 


Ag  =  grating  area 

R  =»  resolving  power 

i  -  V  number  *  l/P 

L  -  entrance  aperture  height 

F  =  focal  length  of  mirror 

and  It  Is  assumed  that  the  system  Is  "energy" 
limited  not  diffraction  limited.  The  resolu¬ 
tion  In  the  usual  spectrometer  Is  generally 
Inversely  proportional  to  the  entrance  aperture 
(slit)  width. 

A  grille  or  nask  may  be  employed  as  an 
entrance  aperture,  exit  aperture,  or  both,  to 
improve  the  performance  of  the  system.  These 
grilles  were  first  employed  by  Golay  (Go! ay, 
1949;  Girard,  1963)  to  Increase  the  effective 
entrance  and  exit  apertures  without  sacrificing 
resolution  (throughput  advantage).  It  Is  also 
possible  to  use  them  to  multiplex  various  wave¬ 
lengths  using  one  detector,  (Golay,  1949)  thus 
Improving  the  signal-to-nolse  ratio  of  the 
measurement  compared  with  that  obtained  by 
recording  each  wavelength  In  sequence  (multi¬ 
plex  advantage).  A  grille  spectrometer  may 
have  both  the  throughput-  advantage  and  the 
multiplex  advantage  (Harwlt,  et  al.,  1970)  end 
can  compete  with  an  Interferometric  spectro¬ 
meter,  without  requiring  the  extreme  mechanical 
stability  of  the  interferometer  (Vanasse  and 
Sakai,  1967).  A  great  variety  of  grilles  have 
been  employed  as  summarized  in  Table  I.  Golay 
(1953),  the  pioneer  of  this  field,  mentioned 
that  Walsh  functions  might  be  useful  as  grille 
patterns,  but  they  have  only  been  recently  em¬ 
ployed  despite  their  natural  advantage  of  being 
a  complete  ortho-normal  set  of  "on-off"  form. 


General  Formulation 

The  operation  of  a  grille  spectrometer  may 
be  mathematically  modeled  by  describing  the 
total  radiation  Intensity  Incident  on  the  de¬ 
tector  in  terms  of  the  Incident  radiation 
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spectrum  and  the  functions  that  describe  each 
element  of  the  entrance  and  exit  grilles  (see 
Figure  2).  tach  element  Is  a  slot  whose  width 
determines  the  spectral  resolution  of  the 
spectrometer,  just  as  the  single  silt  does  for 
a  monochromator.  The  entire  entrance  and  exit 
apertures  are  filled  with  slots  and  each  slot 
can,  In  general,  be  modulated  (opened  or  c’csid) 
Independently  of  any  other  slot.  As  shown  lr- 
Figure  2,  the  effect  of  the  grating  Is  tc 
cause  radiation  of  amplitude  a^  and  wavelength 
number  i  entering  slot  j  to  be  shifted  to  the 
exit  slot  i  + 

In  general,  we  wish  to  encode  each  slot  In 
the  spectrometer  so  that  we  can  measure  and  re¬ 
cord  all  the  exiting  radiation  and  then  re¬ 
cover  an  estimate  of  the  spectral  elements 
(Af).  Thus,  let  %‘j  represent  the  encoding 
function  for  entrance  slot  j.  Similarity 
will  represent  the  exit  slot  encoding  function. 
The  total  exiting  radiation  Is  therefore  de¬ 
scribed  by  summing  all  radiation  over  all  wave¬ 
lengths  that  enter  each  entrance  slot  and  leave 
each  exit  slot.  Thus, 

S  *  t  t  t  «(t  +  j  -  k) 

i  3  k 

where  s  Is  the  signal  that  Is  detected,  re¬ 
corded  and  later  analyzed  to  recover  Uv)  and 
6  Is  the  unit  delta  function.  The  function  * 
and  ♦  can  of  course  be.  In  general,  any  of  a 
very  large  set  of  functions.  However,  our  In¬ 
terest  here  Is  to  restrict  each  i  and  $  to  be 
some  modified  combination  of  Walsh  functions; 
modifying  referring  to  the  on-off  properties. 
Thus,  we  define  an  offset  Walsh  function  Xj 

Xj  (e)  -  ft1  1  , 

where  Wal  U, o)  is  the  usual  notation  for  the 
Welsh  functions.  The  functions  $  and  *  are 
often  combinations  of  the  Ar's  which  take  on 
only  the  values  0  or  1. 

It  Is  a  well  known  property  of  Walsh  func¬ 
tions  (Harmuth,  1970;  p.20)  that 

Wal  (h,o)  Wcl  (k,©)  «  Wal  {>ak, o)  , 

where  the  operator  -ft  signifies  the  module  2 
sum.  Thus,  it  Is  found  that 

Zxt  *k  •  *j*k  *  +  h  -  1  * 

For  the  case  where  #  and  $  are  taken  as  "offset 
Walsh  functions"  then 

2s(o)  -  t  z  t  x£  &  If  [it  o,  k)l 
i  j  k 

•t^(e)  +  ^.(0)  +  ^(e)] 

where  the  f(i,  j,  k)  determines  how  the  x  func¬ 
tions  are  assigned  to  the  slots.  Since  the 


Walsh  and  hence  the  x  functions  form  an  orthog¬ 
onal  set,  each  of  the  above  terms  (that  are 
unique)  can  be  extracted  from  the  recorded 
signal  S  by  Walsh-Fourler  analysis. 

Multiplex  Advantage  Grille  Spectrometers 

The  Grille  Spectrometers  of  Golay  (1951), 
Ibbett  et  al.  (1968),  Sloane  et  al.  (1969),  may 
be  described  by  choosing  the  constants  one  for 
a  single  entrance  slot  and  zero  for  the  remain¬ 
ing  entrance  slots.  Then  orthogonal  functions 
are  chosen  for  the  exit  slots,  thus  multi¬ 
plexing  the  amplitudes  of  the  spectral  elements 
onto  a  single  signal.  An  excellent  choice  for 
the  exit  slot  functions  Is,  of  course,  the 
"offset  Walsh  functions"  (see  Figure  3  for  an 
example)  and  the  radiation  spectrum  may  be  re¬ 
covered  by  a  Walsh-Fourler  transformation. 

Thus, 

25(0)  *  tit  A*  6{j)  6  (i  +  o  -  It) 

i  0  k 

<x^k(e)  +  ^.(e)  +  xk{o)  -  l] 

S(0)  -  t  A.  xAo) 

•  It 


and  thus  the  spectrum  Is  easily  recovered  as 
A  »  Walsh  Transform  ts(o)] 


Throughput  Advantage  Grille  Spectrometers 

The  Grille  Spectrometers  of  Golay  (1951), 
Girard  (1963),  and  others  employ  Identical 
(except  for  displacement)  entrance  and  exit 
grilles  but  record  only  the  average  value  of 
the  modulated  signal  and  exhibit  very  high 
luminosity.  In  analogy  with  the  Girard  grille, 
a  grille  herein  named  a  sal  qrllle  may  be  form¬ 
ed  using  the  "offset  sal  functions".  This 
grille  may  be  compared  with  Girard's  grille  In 
Figure  3.  The  output  signal  Is  ?1ven  by  the 
average  of 

25(c)  ■  r  :  I  A .  «(i  +  Zj  -  2k)  &{Zk  -  n) 
i  j  k 

•t*2j<»2k(0)  +  x2/e)  +  x2 *(o)  -  11 

or  _ 

25(e)  .in.  [*(n_t)*«(0)  + 

t  J 

x~  .(e)  +  x  (e)  -  1] 

n 


where  n  =  displaced  number  of  slots  as  the  exit 
mask  Is  moved  across  the  exit  aperture.  Since 
Xn  »  0  if  n  f  0,  then  for  n  f  0 


where 


t-  2irtrj-im-n 


25(0)  •  £  Z  «(»-i)  Uo(e)  ♦  *O(0)  +0-1] 
i  J-l 

5(0)  ■  J  Z  X.  s(n-i)  +  J 

V  * 


Thus,  for  position  n ,  the  signal  averaged  over 
the  Independent  variable  e,  produces  a  measure 
of  the  spectral  component  xn.  Note  the 
throughput  advantage  Indicated  by  the  factor  j. 

It  Is  Interesting  to  note  that  In  practice, 
difficulties  were  experienced  with  the  Girard 
grille  In  that  nonuniform  Illumination  on  the 
entrance  aperture  produced  serious  distortions. 
Moret-Ballly  et  al.  (1970)  developed  a  "random 
grille"  composed  of  slots  “randomly"  chosen  to 
be  open  or  closed  to  overcome  this  problem.  A 
similar  grille  can  be  realized  using  a  pseudo¬ 
random  sequence  which  may  In  some  cases  be  a 
certain  Walsh  function  with  the  leading  element 
deleted.  These  sequences  would  be  pseudo- 
randomly  arranged  to  produce  a  pseudo-random 
grille  with  properties  very  similar  to  the 
"random"  grille  of  Moret-Ballly  et  al. 

Multiplex  and  Throughput  Advantage  Grille 
Spectrometers 

The  grille  spectrometer  of  Harwlt  et  al. 
(1970)  employed  grille  functions  derived  from  a 
Hadamard  matrix  which  for  some  cases  (but  not 
most)  are  also  Walsh  functions.  Separate  masks 
are  required  for  the  entrance  and  exit  aper¬ 
tures  and  they  must  be  displaced  Independently. 
Nevertheless,  this  configuration  with  both  the 
throughput  and  multiplex  advantage  greatly  Im¬ 
proves  the  performance  of  a  spectrometer. 

It  Is  also  possible  to  derive  a  grille 
spectrometer  with  the  above  properties  but  with 
the  Important  advantage  that  a  single  common 
mask  can  be  used  for  both  the  entrance  and  exit 
apertures.  Such  an  arrangement  Is  shown  In 
Figure  4  for  a  Uttrow  mount.  This  "Walsh 
grille  spectrometer"  would  be  very  similar  to 
the  mock  Interferometer  devised  by  Hertz  (1965), 
but  would  be  without  Its  disadvantages  and  would 
employ  "offset  Walsh  functions"  for  encoding 
purposes.  Thus,  In  terms  of  the  above  for¬ 
mulations  let  0.  *  »  x.  then 


ZS  »  l  t  \i 

i  J 


X(i+d)+j*  Xi+j 


+  -  1] 

0 


2  s  =  ?fcFx 


Now  by  a  Walsh-Fourler  transformation  of  5 
the  sequency  amplitudes  t  can  be  recovered. 
Thus 


-•+ 

C  X  *  24 

In  general  £"ls  not  square.  Therefore,  the 
least  square  estimate  of  the  amplitudes  of  the 
spectrum  x  Is 


r* 


C  \  » 


tc 


tA 


r-  2r*  ?\-xr* 

An  example  of  how  the  spectrum  t  can  be  re¬ 
covered  for  the  case  where  four  separate  ele¬ 
ments  are  to  be  ascertained  Illustrates  the  de¬ 
sign  of  such  an  Instrument.  It  is  convenient 
to  use  a  mask  of  2n  -  1  or  seven  slots  for  n  « 

4  spectral  elements  (this  Is  not  a  requirement, 
however).  Consequently, 

2S  "  t-0  j-1  +  +  *3  ‘  1] 

can  be  expandg^and  common  terms  collected  to 
form  2 s  *  r  C  x  where 

"4  -4  -4  -4 
16  0  0 
116  0 
F-  1215 

1111 
0  113 
0  0  3  1 
0  1  0  2 

H  Is  then  found 

r-  2(FtF-1F 

or  F*  * 


.176144 

-.050292 

-.022536 

-.009004 

.029118 

.150659 

-.026963 

-.063176 

.075509 

-.005634 

.125660 

-.046127 

.100225 

-.014821 

-.021023 

.126166 

.066880 

.003793 

.012464 

.019143 

.024363 

-.015691 

-.005163 

.070177 

.018691 

-.027126 

.056548 

.008422 

.016453 

.001309 

-.019275 

.047543 

Now  to  estimate  the  spectrum  of  the  radla 
tlon  that  Impinges  on  the  entrance  aperture, 
the  coded  disk  is  rotated  and  the  signal  S  Is 
recorded.  A  Walsh-Fourler  transform  of  S 
yields  the  se^ujncy  components  ?,  Then  the 
spectrum  x  *  D  6. 


:  * 
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Sumary 

Grille  spectrometers  have  a  great  advantage 
over  the  usual  monochromator  and  compare  favor¬ 
able  with  the  Interferometric  spectrometers  In 
sensitivity.  6r111c  patterns  of  offset  Walsh 
functions  produce  especially  useful  Instruments. 
Three  new  configurations  of  grille  spectro¬ 
meters.  the  sal  grille,  the  two-dimensional 
pseudo-random  grille,  and  the  Walsh  grille 


spectrometers  were  synthesized  using  Walsh 
functions.  The  Walsh  grille  spectrometers  has 
several  significant  advantages  over  all  the 
other  types  of  grille  soectrometers ,  exhibiting 
both  the  throughput  and  multiplex  advantage 
using  a  single  common  mask  for  both  the  en¬ 
trance  and  exit  apertures  and  requiring  no  more 
than  2n  -  1  measurements  If  n  spectral  elements 
are  to  be  determined. 


Table  I.  GRILLE  PATTEPNS  FOX  SMILE  SPECTROMETERS 


GRILLE  DESCRIPTION 

REFERENCE  EMPLOY 

KtrtKtNCt  INU.SH  FUNCTIONS 

THROUGHPUT 

ADVANTAGE 

MULTIPLEX 

ADVANTAGE 

Complementary  series 

Golay  (1949) 

No 

Yes 

No 

Hyperbolic 

Girard  (1963) 

No 

Yes 

No 

Hock 

Hertz  (196S) 

No 

Yes 

Yes 

Circular  symmetry 

Tinsley  (1966) 

No 

Yes 

No 

Fourier  coded 

Grainger  et  at.  (1967) 

No 

No 

Yes 

Truncated  Walsh 

Ibbett  et  at.  (1968) 

Ves 

No 

Yes 

Algebraic  code 

Decker  and  Harwltt  (1968) 

No 

No 

Yes 

Hadamard  -  single  encoded 

Sloane  et  at.  (1969) 

No 

No 

Yes 

Hyperbolic 

Girard  (1970) 

No 

No 

Yes 

Psuedo-random  -  one  dimensional 

deGraaww  and  Veltman  (1970) 

f»> 

l. 

No 

Yes 

Hadamard  -  double  encoded 

Harwltt  «t  al.  (1970) 

Yes 

Yes 

Yes 

Random 

Moret-Ballly  et  al.  (1970) 

No 

Yes 

No 

Sal  function 

Oespaln  and  Vanasse  (1972)* 

Yes 

Yes 

No 

Psuedo  random  -  two  dimensional 

Despair!  and  Vanasse  (1972)* 

Yes 

Yes 

No 

Walsh  function 

Oespaln  and  Vanasse  (1972)* 

Yes 

Yes 

Yes 

•These  grilles  are  described  In  this  paper. 
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Abstract 

The  Hadamard  transform  scintilla¬ 
tion  counter  designed  to  measure  the 
angular  or  spatial  distributions  of  nuc¬ 
lear  and  atomic  particles  In  the  pre¬ 
sence  of  heary  noise  from  the  photomul¬ 
tiplier  is  described.  The  gain  in  the 
effective  signal-to-noise  ratio  achiev¬ 
ed  by  this  counter  in  the  result  of  the 
spatial  multiplexing,  that  is,  of  cod¬ 
ing  the  spatial  or  angular  distributi¬ 
on  to  be  measured  before  counting  it. 

The  counter  consists  of  a  multi¬ 
element  heterogene  scintillator,  two 
lightguldes,  two  photomultipliers  and 
an  electrical  puls  bipolar  counter.  The 
multiscintillator  consists  of  (2M-1) 
scintillation  elements.  The  lightflashes 
can  enter  only  the  lower  or  only  the 
higher  lightguldes,  the  (H-l)  elements 
of  the  multi-scintillator  being  outside 
the  1  ightguide. 

The  counting  rate  to  be  measured 
is  equal  to  the  difference  between  the 
number  of N  (i) events  and  the  number 
ofs(i)  events  at  al  1  H  posi t1onsfOi«i*-/> 
of  the  movable  multi-scintillator  rela¬ 
tive  to  the  lightguldes.  It  is  needed 
to  perform  n  independenr  measurements. 

The  spatial  distribution  of  par¬ 
ticles  undergoes  the  binary  coding  ac¬ 
cording  to  the  Hadamard  transform  al¬ 
gorithm.  The  system  of  the  multiplex 
Hadamard  transform  detection  gives  rise 
to  the  gain  in  the  signal-to-noise  ratio, 
being  equal  to  fjf+iVvJTwhere  h  is  the 
number  of  the  element-scintillators  in 
the  multiplex  block  scintillator.  Neit¬ 
her  the  reduction  of  the  angular  reso¬ 
lution  nor  the  lost  of  the  counting 
rate  of  the  useful  events  take  place. 

The  Hadamard  transform  scintillation 
counter  gives  the  direct  efficiency  gain 
<n  the  working  time  of  particle  accele¬ 
rators  and  also  in  the  cost  of  the 
equipment. 

Introduction 

The  multiplex  transform  detectors 
of  particles  provide  a  new  c’ass  of  in¬ 
struments  designed  for  use  In  the  nuc¬ 
lear  physics  laboratories.  The  basis 
for  the  existence  of  such  Instruments 
is  the  renouce  af  the  traditional  lo¬ 
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gics  by  sampling  point  by  point  of  the 
unknown  distribution.  In  contrast  to 
this,  the  subject  to  be  measured  in  the 
multiplex  transform  system  is  the  coded 
integral  transform  of  the  function  desc¬ 
ribing  the  distribution  to  be  investi¬ 
gated. 

The  multiplex  system  of  particle 
detection  is  characterized  by  high  im¬ 
munity  against  the  different  foreign 
perturbations.  This  property  opens  up 
the  possibility  to  overcome  the  limit 
put  up  by  the  traditional  logics  of  ob¬ 
servation.  ... 

It  was  M.H.  Fizeau'  who  perfor¬ 
med,  more  than  a  hundred  years  ago,  the 
first  multiplex  measurement  in  optics. 

At  the  late  forties  the  ideas  of  multi¬ 
plex  optical  spectroscopy  arose/2/.  The 
basis  of  the  present  paper  Is  as  follows: 
the  multiplex  communication , a  particu¬ 
lar,  Walsh  Hadamard  multiplex  systems/3/, 
modern  multiplex  Hadamard  transform  spec¬ 
troscopy/4,9,11/  and  the  correlation 
time-of-fl Ight  method  in  neutron  spectro¬ 
scopy/5,®/.  The  multiplex  Hadamard  tra¬ 
nsform  scintillation  counter  is  descri¬ 
bed  below///. 

Traditional  Logics  of  the  Experiment 

In  performing  the  experiment  the 
investigator  always  must  choose  the  op¬ 
timum  relation  between  the  factors  which 
are  multially  exclusive.  For  example, 
the  rise  of  the  counting  rate  by  incre¬ 
asing  the  sizes  of  the  scintillator 
(Fig.  1)  inevitably  makes  the  spatial 
resolution  of  the  counter  worse.  Parti¬ 
cularly  a  hopeless  task  awaits  the  In¬ 
vestigator  when  the  useful  events  are 
so  rare  that  the  noise  from  the  counter 
becames  the  principal  limiting  factor, 
and  the  noise-error  exceeds  the  statis¬ 
tical  error. 

It  is  easy  to  show  that  any  ways 
for  Increasing  the  counting  rate  would 
come  to  the  loss  of  spatial  resolution. 
There  are  traditional  solutions  of  this 
conflicting  situation.  One  of  them  con¬ 
sists  in  the  increasing  of  the  working 
time  of  the  expensive  particle  accele¬ 
rator.  Another  way  of  the  solution  is 
the  converting  of  the  one-channel  sys- 
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ten  Into  the  multi-channel  equipment. 

The  economical  after-effects  of  these 
methods  are  obvious. 

Mul tl-Element  Scintillator 

Meanwhile  there  is  a  nontraditional 
solution,  namely,  the  use  of  the  multi¬ 
plex  transform  system  of  particle  detec¬ 
tion.  The  passage  to  the  multiplex  scin¬ 
tillation  counter  can  be  performed  as 
follows.  First  of  all,  the  spatial  re¬ 
solution  of  the  system  must  be  left 
unchangable.  For  this  aim  we  take  seve¬ 
ral  element-scintillators  and  one  photo¬ 
multiplier.  The  group  of  element-scintil¬ 
lators  is  arranged  in  a  such  a  way  chat 
gaps  between  some  elements  are  left. 

The  counting  strips  and  the  gaps  alter¬ 
nate  one  another.  The  law  of  this  alter¬ 
nation  is  given  by  the  pseudorandom  dis¬ 
crete  sequence  g  (1).  The  number  M  of 
elements  must  be  chosen  according  to  the 
cyrlic  transorthogonality  .  This  pro¬ 
perty  is  expressed  by  the  relation 

M-l 

6(i)  *  id)  ‘  -  g  (k)  g(‘  >  k  )  “ 

In  0 

(1) 

-  (Ml- 1)  S(i)  -  l(i } 


and  can  be  satisfied  only  for  several 
values  of  M.  For  example,  for  M  =  11, 
the  function  g  (i)  is  as  follows* 

il,  it,  -l,  ii,  ii,  ,  i,  -l,  -l.  -l,  .  -l.  (2) 

The  function  g  (1)  can  be  subdivided  in¬ 
to  the  two  unipolar  terms 


i.e.  the  gain  in  the  effective  signal- 
to-noise  ratio  achieved  by  this  unipolar 
system.  However,  the  unipolar  system  g^ 
(i)  is  not  yet  optimal.  It  is  desirable 
and  effecient  to  take  the  bipolar  system 
For  this  aim  we  take  another  comb  with 
many  element-scintillators  and  gaps 
according  the  ^  _ ( 1 )  function.  Both  sys¬ 
tem  supplement  each  other.  The  multiplex 
advantage  of  such  a  bipolar  system  is 
equal  to 

-4^-  (7) 

The  light-flashes  can  enter  only 
the  lower  or  only  the  higher  lightguides 
(Fig.  3),  the  (M-l)  elements  of  the 
scintillator  being  outside  the  two  light 
guides.  The  whole  neterogene  scintilla¬ 
tor  can  be  moved  between  the  two  1 1  g h ♦ 
guides . 

The  electrical  pulses  from  the 
photomultipliers  are  fed  to  the  countir 
device,  the  upper  channel  being  in  thr 
anti-phase.  Therefore,  the  counting  ra 
of  the  upper  system  is  subtracted  from 
the  counting  rate  of  the  lower  system. 
The  intermediate  data  measured  by  this 
bipolar  system  is  the  difference  of  the 
counting  rates  (Fig. 4). 

AJV  (i)  ,  N,  (i)  -  SJi)  (8) 

between  the  number  of  pulses  from  the 
lower  N.  (i)  system  and  the  number  of 
pulses  from  the  upper  li.(i)  system.  This 
difference  must  by  sampled  M  times  for 
different  mutually  independent  positions 
of  the  movable  scintillator.  The  values 
of  AN(1)  can  be  both  negative  and  posi¬ 
tive. 


g(i)  i  (i)  i  (i) 

where 


g¥(i)->il.  il,0,  il,  il,  it,  0,0,0,  *1,0  (4) 


gji) « o,  o,  -l,  o,  o,  o,  -1,  -1,  -1,0,  -i .  ( 5 ) 


The  unipolar  system  4^(1)  of  seve¬ 
ral  elements  (+1)  and  gaps  (0)  is  shewn 
In  Fig.  2.  The  multiplex  advantage  of 
this  unipolar  multiplex  system  /V  is 
equal  to 


General  Description  of  the 
Operation 


The  measurements  performed  by  the 
multiplex  scintillation  counter  are 
made  in  two  stages:  the  detection  stage 
and  the  processing  one.  In  the  course 
of  the  first  stage  the  function  f(i)  to 
be  searched  is  converted  into  the  integ¬ 
ral  transform 

r(  i)  /  (i)  x  g  (i)  ( 9) 

where  '*  is  the  operation  of  convolution 
which  is  performed  simultaneously  in 
the  course  of  the  measurements.  The 
transform  r  (1)  is  sampled  at  all  values 
of  1,  from  1int  “  0  t1]1  ifinal  “M-l . 

The  really  measured  function  s(i)  is 
equal  to 
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s(i)  r.  I  (i)  x  4(1)  f  \n(i) 


(10) 


1 


JF' 


~T*ZJ7* 


where 

t\n(i)  =  nf  (i)  —  n]  (i)  (11) 

and  « *  (1)  (k  =  1,2)  is  the  noise  count¬ 
ing  rf te  of  the  k-photomultiplier  at 
all  M  ,'ositions  of  the  movable  multi¬ 
plex  scintillator.  Obviousely 

I^Anfii  M  [An(/;  ),r«  0  (12) 


The  intermediate  data  s(i)  are  to  be 
retransformed  according  to  the  algo- 
ri  thm 


l  a)  . — - — {3(i>  x  |(0 +2  s(o  g(i)  1  (13) 

""  ,1/+/  1=0 

where  is  the  operation  of  correla¬ 
tion.  The  second  term  in  (13)  reflects 
the  second  term  in  relation  (1). 

Without  noises  the  following  rela¬ 
tion  holds 


itd)'*  id)*  6 ( 0  =  (M*l)  it(i) 

In  Q  Ini) 


In  the  presence  of  noises  relation  (14) 
is  valid  only  approximately  in  the 
1 i mi ts  of  (12). 

If  the  statistical  error  of  the 
measurements  of  the  useful  events  f(i) 
is  negligible,  then  the  total  error 
is  determined  by  the  noise  from  the 
photomultiplier;,  and  finally 


- [s(ii  •/  g  ( i)  *■  £  s(Ox  g(>)  1 ■ 

.1/.  /  1=0 


— —  [  /  (i)  ,  g  (i)  ♦  1  t  (i)  y  i(i)  I  +  ( ^  5 ) 

.1 Ul  ‘  =  o 


-  Ai '(i)  =  i(i)  +  A v(i )  . 

Let  us  compare  this  result  with  the 
traditional  system  of  a  homogeneous 
scintillator.  For  the  latter  system 

1  (r.d  (i)  *■  t  (i)  +  \  n(i  )  (16) 

The  gain  in  effective  signal-to-noise 
ratio  is  given  by 


The  corridor  of  noise  errors  for  the 
bipolar  multiplex  transform  system  is 
(M  +  1)\TJ  times  narrower,  than  for 
the  traditional  system. 


Results  of  the  Simulation 

The  simulation  accomplished  for 
the  ca -e  of  M  =  19  clearly  demonstrates 
the  efrect  of  supression  of  the- noise- 
error.  The  initial  distribution  f(i) 
from  iin  =  0  till  ifl-n  =  18  is  shown  in 
Fig.  5.  The  bipolar  kernel  g  (i)  for 
M  =  19  is  given  in  Fig.  6.  The  integral 
transform  r  (i)  shown  in  Fig.  7  is  the 
subject  of  the  measurements.  The  bipolar 
multiplex  system  without  noise  does 
sample  the  function 


r(ij  =  td)y  g<t>=  s  t(k)ta-k)  (is) 

k  »  0  '  ' 


This  intermediate  data  undergo  the  decod¬ 
ing.  The  results  of  the  correlation 

r(  i)  x  g  (i )  (1 

are  shown  in  Fig.  8.  This  function  d’, 
fers  from  the  initial  function  f(i)  in 
two  points,  namely,  in  the  ratio  of  sca¬ 
ling  and  in  the  different  biases. 

The  noiss  components  n,(i)  from  the 
lower  photomultiplier  and  n,  (i)  from 
the  upper  photomul ti pi ier  are  shown  in 
Fig.  9.  The  bipolar  pulse  counter  detects 
the  fluctuating  component  of  the  noise 
An  (i),  shown  in  Fig.  10.  The  results 
of  decoding  of  the  fluctuating  noise 
component  are  given  in  Fig.  11.  The  ra¬ 
tio  of  standard  noise  errors  found  for 
this  simulation  is  equal  to  4.65, 

instead  of  the  theoretical  mean  value 

/  /  ,  •>/  f  / 

‘  ^multip.  )  iheor.  —  a 

V* 
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Fig.  9.  The  noise  components  n,  (i)  and 
n  2  (i)  from  the  lower  and  from 
'•  the  upper  photomultipliers. 


Fig.  10.  The  fluctuating  noise  component 
A  "  0)  • 
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Fig.  11.  The  decoded  fluctuating  noise 
component  \ v  ( i ) . 
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Abstract 


The  multiplex  Hadamard  transform 
target  designed  to  measure  the  angular 
distribution  of  the  particles  in  the 
presence  of  heavy  background  in  the 
experimental  hall  is  described.  The 
gain  in  the  effective  signal -to-back- 
ground  ratio  achieved  by  this  multiplex 
target  is  the  result  of  spatial  multi¬ 
plexing,  that  is,  of  coding  the  angular 
distribution  to  be  measured  before  count¬ 
ing  it. 

TH«  multiplex  target  has  multi¬ 
element  heterogene  structure,  which  per¬ 
mits  the  detection  of  particles  at  se¬ 
veral  angles  simultaneously  by  the  integ¬ 
ral  coding  algorithm.  The  transform  co¬ 
de  is  the  cyclic  trans-ortl.ogonal  Hada¬ 
mard  code.  The  angular  distribution  Of 
particles  to  be  measured  can  be  found 
on  the  second  stage  by  decoding  trans¬ 
formation  with  the  same  coae,  as  was 
used  on  the  stage  of  primary  coding. 

The  multiplex  target  gives  the 
gain  ’’n  the  signal -to-background  ratio 
if  the  background  does  not  depend  on 
the  parameters  of  the  target  and  the 
beam.  This  gain  is  equal  to  (M t  :)/2\/M  , 
where  it  is  the  number  of  coma  elements 
of  the  multiplex  target.  The  multiplex 
Hadamard  transform  target  gives  the 
direct  efficiency  gain  in  the  working 
time  of  particle  accelerators  and  also 
in  the  cost  of  the  equipment. 


Introduction 

The  traditional  target  used  in  the 
experiments  with  high  energy  particles 
consists  of  the  substance  of  desirable 
agrigate  state.  The  target  possesses 
almost  homogeneous  properties  inside 
the  region  at  which  the  beam  of  accele¬ 
rated  particles  hit.  The  sizes  and  the 
depth  of  the  target  are  chosen  accord¬ 
ing  to  the  required  energy  and/or  angu¬ 
lar  resolution. 

The  counter  or  the  particle  teles¬ 
cope  of  several  counters  is  commonly  hie 


not  only  by  the  particles  which  emerge 
from  the  target  but  also  by  the  partic¬ 
les  which  originate  outside  the  target 
and  are  the  background  ones.  At  the 
high  level  of  background  particles  the 
error  of  the  measurements  is  determin¬ 
ed  almost  completely  by  the  background. 

Any  variations  in  the  geometrical 
sizes  of  the  counter  do  not  change  the 
relation  between  the  useful  events  and 
the  background  ones.  The  increase  of  the 
target  dimensions  does  deteriorate  the 
spatial  or  angular  resolution  of  the 
system. 

Multi-Element  Target 

Meanwhile  there  is  a  nontraditional 
solution  of  this  conflicting  situation, 
namely  the  use  of  the  multiplex  target. 

By  leaving  unaltered  the  spatial  resolu¬ 
tion  of  the  target  we  take  several  ele¬ 
ments  of  target  and  perform  the  measure¬ 
ments  simultaneously  at  several  angles. 
Thus,  the  one  and  the  same  background 
event  detected  by  the  counter  falls 
within  several  angular  intervals,  but 
not  within  a  singular  angular  interval 
as  in  the  traditional  target. 

For  this  aim  the  target  is  trans¬ 
formed  into  heterogeneous  multiplex  tar¬ 
get.  The  latter  has  the  structure  of  a 
comb.  The  prongs  and  gaps  of  the  comb 
alternate  one  another.  The  law  of  this 
alternation  is  given  by  the  discrete 
pseudorandom  unipolar  sequences  g^d)  or 
g_  (i )  ■  The  function  g+ (i )  can  have  the 
values  +1  or  0  and  the  functipn  g- (i ) 
the  values  (-1)  or  0.  The  function  g(i) 
which  is  equal  to  the  sum  of g+(i)  and 
g_  (i)  functions  forms  the  row  of  the 
truncated  Hadamard  matrix  with  the  trans- 
orthogonal  properties,  that  is 

M-l 

&  ( i)  x  £  ( i)  -=  S  g(i)  6(i+k)  * 

*=o 

-  (M  +  r  s  (i)  -t(i). 


where  if  is  the  number  of  elements  prongs 
in  comb  target. 


The  anguiar  c ' stribution  of  the  par¬ 
ticles  emerging  rrom  multiplex  target 
undergoes  the  coding  transform.  Instead 
of  the  function  l  (!)  the  counter  does 
sample  the  function 

N,(0  t  fil-x)  £<.  (!)  +  *,  (!)  (2) 

from  the  comb  target  g^(!  )  and  another 
function 

N,(i)  -  l  (!)  X  g-(i)  ^  n,(i)  (3) 

from  the  comb  target  6.(>)  .  Herent(!) 
and  n 3  (i  )  are  the  number  of  the  back¬ 
ground  particles  hit  the  counter  during 
the  first  and  the  second  measurements. 

The  d3ta  to  be  measured  in  the  experi¬ 
ment  a~e  equal  to  the  difference 

,\N(i)  =  x ,(!)  -N}  (!)  (4) 

These  intermediate  data  must  be  retrans¬ 
formed  by  the  decoding  correlation  with 
the  help  of  the  bipolar  g(!t)  function. 

The  result  has  the  form 

l,.,t  (!)  ■  —  -  l\N(i)  X  6  (i)  + 

v~,  (5) 

+  S  A  N(!)  ■*  g  ( i )  1  f  Ai/  (  i  ) 

The  ratio  of  the  mean  square  oackground- 
error  [Ar  (!)  1.,  for  the  multiplex  target 
to  the  m.s.  background-error (  \n(!)  1 
for  the  traditional  sysrem  is  equal  to 
2\/T?  /  (M  :  1)  . 

The  multiplex  target  consists  of 
the  substance  in  any  agrigate  state. 

There  are  two  sets  of  the  containers  or 
frames  for  two  uniooijr  multiplex  comb- 
targets.  The  elements  of  the  combs  can 
move  independently  relative  to  the  par¬ 
ticle  beam.  Two  arrangements  of  the 
comb-elemsnts  must  be  built  according 
to  the  unipolar  sequences  g>d)  or  g-(i)  . 
lhe  change  of  the  polarity  of  the  bi¬ 
polar  counting  device  is  performed  si¬ 
multaneously  with  the  exchange  of  one 
comb-target  to  another  one. 

The  total  number  of  elements  of 
multiplex  targets,  including  prongs  and 
gaps  is  equal  to  (  2M  -  i  ) .  These  ele¬ 
ments  are  subdivided  into  three  groups, 
the  first  qroup  being  outside  of  the 
beam  to  the  left,  the  second  group  of 
elements  hitting  by  the  pripary  partic¬ 
les  of  the  beam  and  third  group  being 
outside  of  the  beam  to  the  right.  In  the 
course  of  the  measurements  the  spatial 
structures  of  the  combs  undergo  the  cyc¬ 
lic  rearrangements.  It  is  necessary  to 
perform  M  independent  measurements  with 
4+(i)  multiplex  target  and  as  many 
with^f/I  multiplex  target. 


The  structures  of  prongs  and  gaps 
for  two  unipolar  multiplex  targets  for 
the  case  of  M  »  7  are  shown  in  Fig.l. 
There  are  13  elements  which  broken  down 
into  three  groups  (Fig.  2).  The  beam 
of  the  particles  shown  as  a  ring  in 
Fig.  2  intersects  only.*/  elements, prongs 
or  gaps  HI .  The  configurations  of  the 
multiplex  targets  g^d)  and  g„(i)  are  shown 
for  the  i  =  3  . 

The  results  of  the  simulation  are 
analogous  to  the  case  of  u  ^  19  /l  /. 

The  ratio  of  the  mean  square  background- 
error  for  the  multiplex  target  to  the 
mean  square  background-error  for _the 
traditional  system  is  equal  to  2\/m/(‘U1). 
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Fig.  1.  The  spatial  structure  of  multi¬ 
plex  target  consisting  of  two 
unipolar  comb-targets.  The  measu¬ 
rements  are  carried  out  at  seven 
different  intervals  { «  »7)  si¬ 
multaneously.  The  comb-targets 
consist  of  13  elements  prongs 
and  gaps,  ( 2.W - /  ).  The  upper 
comb-target  corresponds  to  tho 
g ,  (!)  coding  function.  The  lower 
one  corresponds  to  the  g_(>) 
coding  function. 
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Abstract 


The  particle  telescope  of  two  mul¬ 
tiplex  Hadamard  transform  scintillation 
counters  Is  described.  Each  scintilla¬ 
tor  Is  set  up  of  several  element-scin¬ 
tillators  which  are  surrounded  by  the 
light-guides  and  photomultipliers.  Four 
coincidence  circuits  are  detecting  the 
four  groups  of  events.  The  coincidence 
counting  rates  define  the  intensity  of 
the  angular  correlation  events  Induced 
by  the  two-particle  channels.  And  the 
angular  resolution  of  the  discrimina¬ 
tion  of  the  events  to  be  measured  Is 
equal  to  the  angle  which  subtends  the 
single  element-scintillator  of  the 
multiplex  scintillation  counter. 

jjch  a  particle  telescope  allows 
to  solve  some  new  problems,  for  example. 
It  can  be  used  in  the  experiments  with 
interesting  beams  to  restrict  the  vo¬ 
lume  from  which  the  binary  channels 
particles  are  emerging  and  this  can  be 
done  without  the  additional  defining 
counters . 


'  Introduction 

In  the  previous  communications 
the  Hadamard  transform  scintillation 
counter  /!/,  the  multiplex  target 
and  the  principle  of  their  operation 
have  been  describee.  The  telescope  of 
two  multiplex  scintillation  counters 
presented  earlier  in  the  communica¬ 
tion  /4/  is  reported  below. 

The  traditional  telescope  designed 
to  detect  the  penetrating  particles  is 
set  up  of  two  or  more  scintillation 
counter,  electrical  pulses  from  which 
are  fed  to  the  coincidence  or  anti- 
coincidence  circuits.  The  connections 
between  the  telescope  counter  signals 
are  chosen  in  such  a  manner,  that  the 
output  pulse  would  come  when  the  light- 
flashes  in  either  photomultipliers 
originate  simul taneouscly  that  Is  in 
the  time  resolution  of  the  coincidence 
circuit. 

Let  us  consider  that  traditional 
telescope  of  two  scintillation  counters 


(Fig.  1).  The  pulses  from  the  counters 
are  fed  to  the  coincidence  circuit.  Such 
a  telescope  counts  the  processes  Induc¬ 
ed  in  the  target  by  the  particles  of 
the  beam  when  one  of  the  secondary  partic¬ 
les  Is  emitted  at  the  angle  .and  the 
other  one  Is  emitted  at  the  angle 
(130°  -  e  )  to  the  beam  axis.  To  de¬ 
tect  two-particle  channels  in  the  wide 
interval  of  angles  from  o,  to  e ,  one 
does  the  following.  A  sufficient  small 
target  and  a  sufficient  small  telescope 
angular  view  are  taken,  so  that  the 
halfwidth  of  the  angular  correlation 
curve  has  the  required  value  \o  (Fig. 2). 
Under  real  conditions  the  maximum  of 
the  curve  lays  above  the  pedestal  due 
to  the  background  events  from  many  par¬ 
ticle  channels.  The  measurements  are 
made  at  several  angles  0  from  0,  to 
0-t  .  The  required  results  can  be 

obtained  by  summation  ot‘  the  events 
which  are  above  the  pedestal.  Any  at¬ 
tempts  tc  Increase  the  telescope  angu¬ 
lar  view  give  the  broadening  of  the 
maximum  and  a  higher  pedestal. 


Meanwhile  there  Is  a  nontraditional 
way  to  cover  all  the  correlation  events 
within  the  wide  Interval  of  angles  from 
o,  to  Oj  without  the  loss  of  angular 
correlation  resolution. The  telescope 
which  processes  these  properties  Is  of 
the  following  design.  The  homogeneous 
scintillators  in  the  counters  are 
exchanged  by  the  heterogeneous  multiplex 
scintillators  /*/.  Each  multiplex  scin¬ 
tillator  is  set  up  of  several  element- 
scintillators  (Fig.  3).  The  butt-ends 
of  the  multiple*  scintillators  are 
surrounded  by  lightguides  and  photomul¬ 
tipliers.  The  light-flashes  Induced  by 
the  charged  particles  hit  the  element- 
scintillators  can  enter  only  one  of  two 
lightguides  and  can  not  enter  the  ad¬ 
jacent  element-scintillator.  The  direc¬ 


ts 


'  4?* 
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tions  of  the  light-outcomes  alternate 
according  to  the  law  of  pseudorandom 
coding  '*'•  In  the  case  of  seven  ele¬ 
ment-scintillators  (  «  «  7  ),  this  al¬ 

ternation  of  the  light-outcomes  Is  des¬ 
cribed  by  the  rule 

/  /  •  /  » 

for  the  first  scintillation  counter, 
and  by  the  "mirror"  rule 

i  i  ft  t f  1 

for  the  second  scintillation  counter. 

The  electrical  pulses  from  four 
photomultipliers  are  fed  to  four  coinci¬ 
dence  circuits  (Fig.  4),  thus  permitt¬ 
ing  to  count  four  groups  of  events: 
ff++  ,  ,  n +-  and  iv_+  .  These 

observed  counting  rates,  as  shown  in'4', 
completely  define  the  counting  rate  of 
the  correlation  events  to  be  searched. 
The  angular  correlation  resolution  of 
the  events  with  180°  correlation  angle 
is  defined  by  the  angle  which  subtends 
the  single  element-scintillator  of  the 
multiplex  scintillation  counter,  if  the 
dimensions  of  the  target  being  very 
small.  The  number  of  the  180°-correla- 
tion  events  to  be  searched  is  equal 

-Jrr- (N>~*  N->  >  ( 1 > 

m  —  l 

The  background  correlation  events  from 
many  particle  channels  are  supposed  to 
be  distributed  uniformly. 

It  is  easily  seen  that  this  algo¬ 
rithm  is  valuable  not  only  for  the  esse 
of  the  180°  correlation  angle,  but  also 
for  any  correlation  angle.  The  correla¬ 
tion  angle  is  changing  by  the  turn  of 
the  telescope  arm,  as  in  the  case  of 
the  traditional  telescope.  It  is  pos¬ 
sible  also  to  shear  the  coding  pictures 
of  the  counters  relative  to  each  other. 
The  processing  algorithm  for  the  latter 
case  has  the  form  different  from  (1). 


New  Problems 


The  telescope  of  multiplex  scir.til 
lation  counters  allows  to  solve  some 
new  problems.  Namely,  such  a  telescope 
can  be  used  in  the  experiments  with  1n- 
tersecting  beams  to  restrict  the  volume 
from  which  the  binary  channel  particles 
are  emitted,  and  this  can  be  done  wi¬ 
thout  the  additional  defining  counters. 
Such  an  experiment  is  shown  in  Fig.  5. 
The  telescope  of  two  multiplex  scintil¬ 
lation  counters  c,  and  c,  is  turned 
to  count  the  binary  channel  particles 
emerging 'from  the  cell  with  number  *..o. 

The  algorithm  of  the  processing  is 
defined  by  (1).  The  background  events 
include  the  particles  from  binary  pro¬ 


cesses  which  taking  place  in  the  cells 
with  the  numbers  k  /  o  ,  and  also  the 
uniformely  distributed  particles  from 
many-partlcle  channels. 

The  telescope  of  multiplex  scin¬ 
tillation  counters  allows  to  detect  the 
particles  with  given  curvature  on  the 
background  of  the  particles  with  differ¬ 
ent  values  of  curvature.  Another  examp¬ 
les  are  as  follows.  1)  The  restriction 
of  the  working  volume  inside  the  gaseous 
target  without  the  help  of  the  colllmatr 
ing  entrance  slits  or  defining  counters. 
2)  The  detection  of  the  events  in  the 
target,  immersed  in  the  constant  mag¬ 
netic  field.  The  events  to  be  measured 
are  characterized  by  the  combination 
of  two  parameters:  the  curvature  of 
the  trajectory  and  angular  correlation 
between  particles  . 
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Fig.  1.  Traditional  telescope  of  two 
scintillation  counters  c,  and 
.  The  particle  correlation 
angle  is  equal  to  180°. 
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Fig.  2.  The  angular  correlation  curve 
measured  by  the  traditional 
telescope  as  a  result  of  the 
movement  of  the  one  counter. 
The  mean  correlation  angle  is 
equal  to  0o  and  the  angular 
resolution  is  equal  to  \0 . 


Fig.  3.  The  telescope  of  two  multiplex 
scintillation  counters  and  the 
target  »  .The  telescope  is  set 
up  of  two  multiplex  scintilla¬ 
tors  c,  and  C,  ,  four  light- 
guides  and  four  photomultipliers. 
The  alternation  of  the  light 
outcomes  is  central  symmetrical  - 


Fig.  4.  Four  coincidence  circuits 

coupled  with  four  photomulti¬ 
pliers  of  the  telescope. 
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Fig.  5.  The  experiment  with  intersect¬ 
ing  beams.  The  cells  of  the 
common  volume  are  numerated  by 
the  index  K. 
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SUMMARY 

There  are  increasing  attempts  to  operation  to  gat  a  ganaral  indication 

apply  Walsh  funotions  to  oomaunioa-  of  the  spectral  nature  of  the  elgnal. 

tion  engineering  and  othar  fields. 

This  paper  deaoribaa  tha  reaults  of  IHTRODPCTIOI 

Walsh  and  Fourier  apaotra  of  tha 

vertical  components  of  Rayleigh  waves  Thera  ia  an  upsurge  of  interest 

at  a  set  of  stations,  vis.,  Oulu,  presently  in  engineering  circles  on 

Uppsala,  Copenhagen  and  Stuttgart,  the  use  of  funotions,  such  as  the 

due  to  tha  underground  nuolaar  Walsh  funotions,  with  orthogonal  sari- 

explosion  at  JTovaya  Ssemlya  on  Oot.  as  other  than  the  traditional  sine- 

27,  1966.  It  wao  found  that  both  the  eosine  series.  The  present  paper 

Fourier  and  the  Walsh  spectra  at  all  compares  the  Walsh  and  the  trigono- 

these  stations  have  interference  aetrio  Fourier  power  speotra  of  a  set 

peaks  and  troughs  as  well  as  sharp  of  Rayleigh  waves  (  using  vertioal 

cutoffs  at  both  tha  low  and  high  components  )  from  the  underground 

frequency  ends.  Most  of  the  energies  nuclear  explosion  on  Oot.  27,  1966  by 

in  these  stations  are  oonoentrated  in  the  Russians  at  Hovaya  Ssetslya 

the  0.06  -  0.2  ops  (  Fourier  )  and  recorded  at  several  stations,  vis., 

0.06  -  0.2  sps  (  Walsh  )  range.  An  Oulu,  Uppsala,  Copenhagen  and  Stutt- 

interesting  feature  in  the  Walsh  case  gart  lying  on  or  very  near  the  great 

is  that  the  spectral  heights  can  be  oirola  path  through  the  explosion  site 

put  into  two  groups,  M,  the  primary  and  the  stations, 

one  at  the  lower  sequenoy  range  and 

H,  the  secondary  one  at  the  higher  The  Walsh  function  set,  being  a 

end.  Most  of  the  energy  in  in  the  M  binary  one,  is  directly  suitable 

group  in  case  of  Walsh  spectrun.  with  digital  ooaputers  and  digital 

circuitry.  In  oontrast,  when  the 

In  both  cases,  for  the  farther  Fourier  transformation  by  digital 

stations  the  speotra  shifts  toward  coaputer  as  ths  decoding  process  is 

the  lower  frequency  end.  The  physical  considered,  it  is  known  that  it  falls 

reason  aay  be  due  to  the  propagation  short  of  being  ideal  because  the 

and/or  to  the  gradual  lengthening  of  trigonometric  functions  sine  and 

the  wave  period.  Beoause  of  the  cosine  involved  in  it  are  not  naturally 

ooaplicaoy  in  the  aatheaatical  forau-  fitted  to  the  essentially  binary 

lation  of  arithmetical  convolution  operations  of  digital  ooaputers. 

in  case  of  Walsh  transform,  it  is  Another  advantage  of  using  Walsh 

difficult  to  get  true  ground  motion  function  set  is  that  it  is  a  somewhat 

speotra  from  the  recordings.  Since,  natural  describer  of  pulse  or  pulse- 

however,  the  Walsh  spectrum  obtained  like  signals  (  Brown,  1970);  that 

does  characterise  the  signal,  it  may  makes  it  suitable  for  studying  pulse- 

have  some  use  as  a  simply  performed  like  seismic  signals  such  as  the  P 

waves. 
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Karauth  (  1968,  Bquation  2  )  ha* 
given  the  Valsh-Fourler  aerial 
expansion  of  a  function  F(x)  defined 
in  the  interval  -Y2<x<Y2,  aa 

F(x)  «  a(0)wnl(0,x)  ♦ 

£[ac(i)oal(i,x)  * 

«*'  a3(i)aal(i,x)3 


where,  ,A 

a(O)  -  f F(x)wal(0,x)dx 

-  /W 

a-(i)  *  fF(x)cal(i,x)dx 

0  •/-Vi 

Sg(  i )  =  /F(x)*»d(i,x)dx 

- 


(1) 


Squaring 
expanaion  ( 


the  Walah-Fourier  aeriea 
eqn.  1  )  and  integrating 

over  the  interval  of  orthogonality, 
~Y2<  x  <Y2,  one  geta. 


jff2(x)dx  *  yT/(F2(t/T)dt 

«  ft2(0)  + 

£  t*C2U)  +  «82<D] 

**’  ...  (2) 

where,  x  «  t/T,  I  is  the  tiae  unit 
used  to  normalise  the  tiae  variable 
t  in  cal(i,x)  and  8al(i,x).  The  left 
aide  of  eqn.  2  ia  interpreted  aa  the 
average  power  of  a  signal  F(x). 

a2(0)  and  a02(i)+ae2(i)  are  then 

interpreted  aa  the  power  apeotrua  of 
the  disorete  variable  i. 

For  the  purpose  of  eoaputation  the 
Finite  Valsh  Transfora  theory  and  the 
Fast  Valsh  Transfora  algor it  ha 
developed  by  Kennett  (1970a,  1970b  ) 
were  used.  There  exists  a  oonvenient 
representation  of  the  discrete  Valsh 
funotions  wal(k,j)  in  teraa  of  the 
binary  representation  of  the  indices; 
the  N-length  disorete  Valsh  funotions 
aay  be  defined  for  y  .  &  by  a 
oontinued  product  representation 
(  Kennett,  1970a,  1970b  ). 

For  an  N-length  real  sequenoe 
X(j)  where  j  -0,  1,  2,  ....  N-1, 
the  finite  Valsh  transfora  is  defined 


r'/i 


_ 


!S_ 

:  ’"~-r  '  'i  ■  ;.v3 


rt-t 

X(k)  -  (yN)£x(J)wal(k,J) 

j*o  ...  (3) 

where,  N  «  2**  ;  p  «  1,  2,  . ...; 
k  •  0,  1,  2,  ...,  N-1  and  wal(k,j) 
ia  the  N-length  disorete  Valsh 
funotlon  of  order  k.  Similarly,  X(j) 
aay  be  expressed  aa  the  inverse 
finite  Valsh  transfora  of  the 
sequenoe  X(k), 

N-l 

X(j)  «  Ix(k)wal(k,J) 

Vto 

.*gx(k)waJ(J,k) 

k.o  ...  (4) 

Kennett' s  paper  (  1970a  )  contains 
the  Fortran  prograa  for  coaputing 
the  Fast  Valsh  transfora  for  N  a  128 
i.e.,  for  p  »  7.  This  prograa 
calculate i  the  expression  under  the 
suaaation  sign  in  eqn.  3  naaely, 

N-1 

£x(j)wal(k,J) 

j  =  o 

and  to  get  the  Valsh  transform  the 
values  are  to  be  divided  by  N.  The 
faotor  YS  is  not  of  significance  us 
in  the  ease  of  the  Fourier  transform 
as  one  aay  also  define  the  forward 
Valsh  transform  as 

N-1 

X(k)  »  £x(J)wal(k,j) 

j=o 

and  the  inverse  Valsh  transform  as 

X(J)  -  (FH)  £x(k)wal(k,j) 

k*o 

For  application  to  our  seisaograas 
the  value  of  p  was  taken  to  be  9.  The 
actual  number  of  data  points  were 
less  than  N  »  512  (  being  2  raised  to 
the  power  9  )  points,  so  that  the 
requisite  number  of  seros  were  added 
at  the  end  of  data  to  puke  the  total 
number  of  points  equal  512.  Bennett's 
prograa  was  broken  up  into 
constituent  blocks  and  by  the  addition 
of  similar  blooks  was  extended  for 

N  *»  2^  data  points.  The  extended 
prograa  was  tested  for  F(x)  «  10/x 
and  the  result  was  found  to  be 
identical  to  that  given  by  bin 
(  1970a  ).  A  second  test  was 
successfully  carried  out  by  calculating 
the  Valsh  transfora  of  a  sins  wave 
with  two  cycles. 

VALSH  4  FOUBISR  3PK0TRA 

For  our  work,  part  of  the  Rayleigh 
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mt  train  iron  the  vertical  component 
of  the  Hinoasttr*  due  to  tho 
underground  nuclear  explosion  *t 
Novaya  Ssedya  on  October  27,  1966 
vara  taken.  The  stations  salaotad 
vara  Oulu,  Uppsala,  Copenhagen  and 
Stuttgart  —  all  lying  nearly  on  a 
great  cirola  passing  through  the 
explosion  site  and  the  stations.  The 
seismogram  traoa  amplitudes  ware 
takan  and  the  instruaent  characteris¬ 
tics  and  the  processing  of  data  prior 
to  the  computer  analysis  are 
described  in  a  separata  paper  (  Bath 
and  Buraan,  unpublished  ).  It  may  be 
mentioned  that  the  rata  of  digitisa¬ 
tion  was  taken  to  be  one  sample  per 
second  and  a  sanpled-data  Buttervorth 
filter  (  3  seo  -  133  seo  )  was  used 
to  out-off  frequencies  both  from  the 
highsr  and  lower  sides. 

figure  1  shows  a  filtered  Rayleigh 
wave  train  reoorded  by  the  vertical 
component  Press-Swing  seismometer  at 
Uppsala.  Figures  2,  3,  4,  and  5 
depict  the  Fourier  power  spectra  of 
Rayleigh  waves  recorded  at  Oulu, 
Uppsala,  Copenhagen  and  Stuttgart 
reepeotively.  Figures  6,  7,  8  and  9 
indicate  the  Welsh  power  epeotra  at 
those  stations  taken  in  the  same 
order  as  the  Fourier  apaotra. 

All  the  Fourier  power  spectra  are 
marked  by  sharp  outoff  at  both  ends 
of  the  frequency  scale,  and  alao 
these  are  characterised  by  sharp 
aaplitude  upswings  and  drops,  probably 
due  to  multipath  Interference  and 
other  effects.  The  spectra  at  Oulu 
and  Uppsala  lying  on  a  homogeneous 
geologic  formation  can  more  easily  be 
correlated.  An  interesting  observa¬ 
tion  is  the  shift  in  the  spectrum  at 
Uppsala  towards  the  low-frequency 
end  such  as  the  shift  in  the  peak 
identified  in  both  by  the  letter  A. 
This  shift  may  be  due  to  the  propaga¬ 
tion  and/or  to  the  gradual  lengthen¬ 
ing  of  wave  period.  Zt  is  of  interest 
to  note  that  the  energy  content  at 
higher  frequencies  (  from  about  0.2 
to  0.3  ops  )  at  Uppsala  is  more  than 
that  at  Oulu.  Although  the  reason  is 
not  presently  olear,  it  is  not  dut  to 
any  background  noise.  Nicroaeismio 
spectra  Just  bsfors  the  arrival  of 
the  explosion  energy  at  Uppsala  were 
ooaputed  and  it  is  insignificant; 
this  is  also  boms  out  by  visual 
examination  of  the  record. 

The  interpretation  of  the  tract, 


amplitude  spectra  at  Copenhagen  is 
oomplioated  by  the  faot  that  a 
different  instrument  (  Qalitzin  ) 
with  different  response  characteris¬ 
tics  saa  used.  Besides,  the  spwotral 
response  at  Copenhagen  and  Stuttgart 
were  influenced  by  other  factors, 
such  as,  (a)  deviations  from  the 
great  oirole  path,  (b)  departure 
from  lateral  homogenaity,  and  (o) 
station  factor.  The  peak  A,  at  the 
low-frequenoy  outoff  region,  ham 
shifted  following  the  previous 
observation,  at  Stuttgart  in  compa¬ 
rison  to  that  at  Uppsala. 

The  Walsh  -Harauth  pewar  apaotra 
at  all  these  four  stations  have 
interference  peaks  and  troughs  as 
well  as  sharp  outoff s  at  both  low 
and  high  fraquanoy  ends  as  in  the 
case  of  the  Fourier  ones.  Most  of  the 
energy  is  oonosntratsd  In  the  range 
0,06-0.2  zps,  and  in  oase  of  the 
Fourier  power  spectra  it  ia  approxi¬ 
mately  the  range  0.06-0.2  ops.  Of 
great  interest  in  these  Walsh  spectra 
ia  the  observation  that  the  speotral 
heights  can  be  put  in  two  groups, 

M,  ths  primary  et  the  lower  sequenoy 
range,  and  H,  the  secondary  at  the 
higher  end.  Moat  of  the  energy  is  in 
the  M  group.  For  comparison  it  is 
interesting  to  study  the  Fourier  and 
Walah  apaotra  dua  to  a  damped 
monochromatic  sinusoidal  wave 
(  Campanella  A  Robinson,  1970  ) 
which  is  shown  in  Figure  10.  The 
Fourier  aaplitude  epeotrua  shows 
only  ont  maxims  while  the  Walsh  one 
indicates  two  naxlmaa  corresponding 
to  the  two  groups  M  and  N;  ths  M 
group  containing  mors  ensrgy  ooapared 
to  the  N  one.  Similarly,  ths  M  groups 
in  the  Walsh  speotrm  of  the 
seismograms  represent  greater  energy 
than  the  N  one*  do. 

Kennett  (  personal  communication  ) 
has  given  an  explanation  of  the 
effeota  leading  to  tha  splitting  of 
the  Walsh  power  spectrum  into  M,  H 
peaks.  From  the  logical  analog  of 
the  Wiener  -  Khlnehine  theorem 
(  Rennet t,  1970a,  1970b  )  the  Walsh 
power  spectrum  is  the  finite  Walsh 
transform  of  the  logical  auto¬ 
correlation  given  by 

N-1 

LU(J)  »  (KN)  £X(J©m) 

tn*o  •••  \5) 

whtra  ®  indicates  addition  modula  2 . 


j  n 

y  & 


Sven  for  largo  J  because  of  the 
nature  of  tha  addition  aodula  2  aoao 
^(J),  according  to  Kennett,  will 
only  be  a  aaasura  of  abort  range 
oorralatlon  and  ao  1_( j )  will  ba  a 
aixtura  of  aaaplaa  of  long  and  abort 
range  oorralatlon  in  tbe  record-  which 
will  require  higher  order  Valah 
ooaponanta  to  deaerlbe  thaa  -  the  H 
series.  For  aaallar  j  Kennett  thinks 
this  problea  willnot  be  so  acute  and 
the  M  series  will  ooaa  froa  tha 
aaoothad  out  logical  autocorrelation 
aequence. 

Coapariacn  of  Walsh  apeotra  at 
different  stations  also  as  in  the 
previous  case  show  tha  shift  towards 
low  frequenoy  end  of  the  apeotra  for 
the  farther  stations.  The  spectral 
peaks  J,  K,  and  1  in  tha  region  K 
at  Uppsala  show  shifts  towards  tha 
low  frequency  and  ooapared  to  the 
corresponding  peaks  at  Oulu.  Correla¬ 
tion  of  tha  individual  peaks  become 
difficult  in  case  of  Copenhagen  both 
beoauae  of  (a)  different  instrument 
used,  (b)  station  factor,  the  nature 
of  the  basement  rock  on  which  the 
instrument  rests,  and  (c)  departure 
from  lateral  homogeneity  and  for 
Stuttgart  because  of  the  last  two 
factors  (b)  and  (c).  In  oonformity 
to  the  region  N  the  peak  power  values 
at  F,  R,  and  3  in  the  region  N  at 
Uppsala  indicate,  compared  to  those 
at  Oulu,  a  shift  towards  the  zero 
fraquenoy  and.  Comparison  with  the 
other  two  stations  becomes  difficult 
because  of  the  uncertainty  in 
identifying  the  corresponding  peaks. 

Sffiismm  SHARKS 

In  case  of  the  Fourier  trace 
amplitude  spectra  it  is  a  straight¬ 
forward  procedure  to  get  the  true 
ground  motion  spectrum  by  correcting 
for  the  response  characteristics  of 
the  instrument.  This  follows  froa  the 
well-known  relation  that  the  Fourier 
transform  of  the  convolution  of  two 
signals  is  equal  to  the  product  of 
the  Fourier  transforms  of  the  two 
signals.  Such  a  simple  relationship 
between  convolution  and  the  product 
of  Walsh  transforms  of  two  sequences 
does  not  exist  (  see  equation  8 
below,  Kennett,  1970b  J  making  it 
difficult  to  remove  the  effect  of  the 
instrument  characteristics. 

Given  a  sequence  X(j)  and  its 


Walsh  transform  X(k)  and  another 
sequence  Y(j)  and  its  Walsh  transform 
7(k),  such  that, 

X(J)  **  X(k)  and  Y(j)  Y(k) 

...  (6) 

the  convolution  of  these  two 
sequences  XU)  and  T(j)  is  defined 
by  the  relation, 

N-1 

Zn(s)  -  (XH)  £X( r)Y(s-r) 

where,  ?=° 

Km)  «  0, 

if  m<0,  and  a  •  0,  1,  ...,  N-1. 

...(7) 

Thus, 

N-| 

ZnU)  «  (VN)  £l(r). 

N-1_ 

[2i(k)wal(k,s-r)] 

K- o 

-  (KN)2Kk). 

k=o 

r2fx(r)wal(k,s-r)] 

l-r=o 

N-1  N-1  N-1 

-  ()'H)S'r(ic)S2x(k1). 

U-O  r»o  & ® 

walCk1,  r)wal(k,  s-r) 


...  (8) 

As  seen  froa  Equation  (8)  the 
theoretical  complication  arises  from 
the  laok  of  a  known  relation  between 
the  two  functions 

wal(k1,r)  and  wal(k,s-r) 

The  same  consideration  prevents  any 
simple  expression  for  autocorrelation 
or  orosscorrelation  in  terms  of  the 
Walsh  transform  coefficients. 


_  On  the  other  hand,  given  X(j) 

X(k),  Y(  j)  -*-►  Y(k).  the  logical  or 
dyadic  convolution  (  Oibbs,  unpublish¬ 
ed  report,  1968,  Kennett,  1970b  )  is 
defined  as, 


ZxCs)  =  (W  Sx(r)Y<s©r) 

r=°  ...  (9) 

Symbolically,  it  is  denoted  by. 


Zi  «  X  (*)  T 

...  (10) 

Now. 

2l(s)  -  (yN)  £x(r)Y(8  ®r) 

r«o 

-  (yN)XX(r). 

r*o 

[Zl(k)wal(k,  a  ®  r)] 

*  (yN)SY(k)  [£x(r). 

k*o  j»i  o 

wal(k,r)wal(k,s)  ] 

=  2 X(k)Y(k)wal(k,s) 

k«o 

...  (ii) 

Thus,  the  logical  convolution  is  the 
finite  Valsh  transform  of  the  product 
of  the  Walsh  transforms  of  two 
sequences;  symbolically, 

X  ®  Y—*X.Y 

...  (12) 

A  dose  similarity  is  thus  seen  in 
the  mathematical  structure  between 
the  arithmetical  convolution  in  case 
of  Fourier  and  logical  convolution 
in  case  of  Walsh  transform  theory. 
However,  because  of  the  fact  that  the 
trace  amplitude  in  a  seismogram  is 
the  result  of  arithmetical  convolu¬ 
tion  between  the  ground  motion  and 
the  instrumental  characteristics,  one 
is  not  able  to  use  the  simple 
relation  given  by  the  Equation  (12) 
and  use  of  the  arithmetical  convolu¬ 
tion  expressed  in  Bquation  (8)  is 
complicated,  as  seer,  before,  by  the 
lack  of  a  known  relation  between  the 
two  functions, 

walfk^r)  and  wal(k,  s-r). 

It  is  true  that  by  the  procedure 
adopted  here  one  has  not  obtained  a 
true  Walsh  power  spectrum  of  the 
ground  motion.  Since,  however,  the 
spectrum  obtained  does  characterise 
the  signal  it  may  have  some  use  as  a 
simply  performed  operation  to  get  a 
general  indication  of  the  spectral 
nature  of  the  signal. 

Based  on  cm  analogy  of  detection 


of  radar  signals,  Harmuth  (  personal 
communication  )  has  pointed  out 
another  interesting  possible  applica¬ 
tion  of  Walsh  functions  to  seismology 
and  seismic  prospecting.  A  standard 
way  to  detect  radar  return  signals  is 
by  means  of  the  autocorrelation 
function.  For  long  signals  the 
autocorrelation  function  has  a  peak 
value  when  the  reflected  signal  and  a 
locally  produced  signal  of  the  same 
shape  have  no  time  shift  between 
each  other.  However,  the  sidelobes 
occur  for  oertain  time  shifts.  If  only 
one  radar  target  is  present  this 
causes  no  problem.  If  the  signal  is 
reflectod  by  several  targets  it  is 
difficult  to  decide  whether  a  certain 
peak  in  the  autocorrelation  function 
is  the  main  peak  from  a  second, 
third,  etc.  target  or  a  sidelobe  of 
the  first  target.  By  means  of  Walsh 
functions  one  can  completely 
eliminate,  according  to  Harmuth,  the 
sidelobes  and  thus  obtain  a  definite 
resolution  of  several  targets  that 
are  close  together.  He  envisions  that 
the  same  technique  Bhould  be 
successful  in  the  seismic  problem 
where  a  signal  is  multiplied 
reflected  (  thereby  giving  several 
return  signals  )  through  several 
closely  spaced  layers  in  the  earth. 
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Introduction 


The  enormous  amount  of  marine  seismic  data 
makes  It  necessary  to  process  the  data  with  a 
high  speed  digital  computer.  Fast  Walsh  trans¬ 
form  (FWT)  has  been  used  along  with  the  fast 
Fourier  transform  (FFT)  in  digital  processing 
of  marine  seismic  data.  The  digitized  seismic 
data  processed  include  two  sets  of  seismic  re¬ 
flection  profiler  data  from  the  Woods  Hole 
Oceanographic  Institution  and  one  set  of  seismic 
refraction  data  from  the  Scripps  Institution  of 
Oceanography.  The  objectives  of  the  study  are 
two-fold:  (1)  to  filter  the  marina  seismic 
data  in  order  to  obtain  a  good  estimate  of  the 
time  of  occurrence  for  the  primary  and  the 
secondary  reflections  and  the  first  refracted 
arrivals,  and  (2)  to  reconstruct  the  seismogram 
from  the  filtered  data  rur  a  better  interpreta¬ 
tion  of  the  ocean  subbottoo  structure.  In  our 
preliminary  study  using  IBM  360  Model  40  com¬ 
puter  (presently  limited  to  the  64K  bytes  in 
memory),  FWT  has  demonstrated  two  distinct 
advantages  over  FFT:  (1)  FWT  requires  only  one- 
fourth  of  the  computation  time  as  compared  with 
FFT  with  the  same  number  of  data  points,  and 
(2)  the  simple  linear  Walsh  filtering  can  be 
very  effective.  As  e.  result,  FWT  performs 
better  than  FFT  in  reconstructing  the  marine 
seismogram.  In  this  paper,  the  computational 
aspects  of  Walsh  domain  processing  will  be 
discussed  and  some  preliminary  computer  results 
pre- anted.  Detailed  results  of  Fourier  domain 
processing  have  been  reported  in  Ref.  1. 

Development  of  the  FWT  Algorithm 

Let  yo  be  the  Hadamard  transform  of  the 
data  vector  xjj  with  N  data  points ,  Then 

yN  "  ^  “n  *N  (1) 

where  l/^S"  is  a  normalizing  factor  and  is 
the  Hadamard  matrix.  The  Walsh  transform, 
denoted  as  W[j,  of  the  vector  xr  is  obtained 
by  rearranging  all  components  of  the  vector 
yjj  according  to  the  sequency  order.  Eq.  (1) 
requires  N(N-l)  additions.  If  N  is  a  power 
of  2,  N  ■  2n,  fast  algorithms  have  been  con¬ 
sidered,  A  somewhat  different  approach  is 
used  in  this  paper.  Let  (x)  be  the  Kronecker 
product.  Rushforth  [2]  has  shown  that  the 
Hardamard  matrix,  in  general,  can  be  written 
as 

H2n  -  (H2(x)  I2  @  •••  ©  I2) 

(I2  ®  H2  @  I2"*(x)  I2 )  •  *  * 

(I2  ®  I2  ©  •••  ®  H2)  (2) 


for  the  positive  integer  n,  where  Eq.  (2)  has 
n  factors.  For  n  “  3, 

H8  -  (H2  ®  I2®  I2)(I2®  H2®  I2) 

(I2®  I2®  H2) 

which  can  be  described  by  the  flow  chart  in 
Fig.  1.  Figure  1  can  be  implemented  exactly  in 
the  same  manner  as  the  fast  Fourier  transform 
program  except  replacing  the  multiplications 
in  FFT  with  additions  or  subtractions .  The 
dots  at  stages  Aj,  A2,  A3  represent  the  addi¬ 
tion  except  that  the  subtraction  is  specified 
by  a  minus  sign  above  a  line.  The  results  of 
each  stage  can  be  stored  "in  place"  in  the 
original  vector  xjj.  This  operation  performs 
the  Hadamard  multiplication  upon  Xjq.  The 
resulting  Hadamard  transforms  must  be  un¬ 
scrambled  according  to  the  number  of  sign 
changes  in  the  Hadamard  row  vectors,  the  so 
called  sequency  order.  The  inverse  Walsh  trans¬ 
form  is  an  identical  operation  as  the  Walsh 
transform.  A  detailed  listing  of  computer 
programs  is  described  in  Ref.  3.  Presently  on 
our  computer  facility  the  FWT  program  can  per¬ 
form  transformation  up  to  4096  samples  as 
compared  with  2048  samples  in  using  the  FFT 
program. 


Fig.  1  Flow  Chart  of  an 
Eight-Point  FWT 


Computer  Results 

The  results  presented  in  this  paper  are 
based  on  the  second  set  of  Woods  Hole  seismic 
data  taken  in  lava  sea,  June  1971.  The  sampling 
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rate  is  500  Hz.  Each  shot  has  2048  data  points 
including  the  explosion  which  indicates  the 
starting  time.  Figure  2  is  a  plot  of  shot  522. 
The  primary  reflection  which  occurs  at  0.33 
second  after  the  explosion  provides  information 
on  the  water  depth.  There  are  a  number  of 
multiple  reflections  which  should  be  removed 
or  suppressed.  Walsh  domain  linear  filtering, 
logexponentiul  filtering,  and  nonlinear  filter¬ 
ing  as  described  by  Pratt  [4]  have  been  applied 
to  a  number  of  shots.  By  taking  the  Walsh 
transform  of  shot  522  and  then  the  inverse 
transform  of  the  first  half  of  the  transformed 
samples,  the  result  of  the  linear  filtering 
is  shown  in  Fig.  3.  In  Fig.  2,  the  ratio  of 
the  second  peak  to  the  first  peak  is  0.44. 

This  ratio  is  improved  to  0.406  in  Fig.  3. 

For  loaexp  filtering  of  shot  522  as  shown  in 
Fig.  4,  the  ratio  is  0.42.  Nonlinear  filter¬ 
ing  introduces  many-  high  sequency  components . 
Nonlinear  filtering  of  shot  522  followed  by 
low-pass  filtering  is  shown  in  Fig.  5.  One 
way  to  suppress  the  multiple  reflections  is  to 
bring  each  sample  to  a  power  1  +  e,  where  e  is 
a  small  positive  number,  and  then  filter  the 
data.  For  a  power  of  1.2,  the  ratio  of  the 
second  to  the  first  peak  of  the  linearly 
filtered  data  was  found  to  be  0.315.  The  dis¬ 
advantage  of  this  method  is  the  suppression  of 
useful  but  low-amplitude  data.  Several  shots 
of  data  can  be  combined  by  simple  averaging  to 
improve  the  signal-to-noise  ratio.  Linear 
filtering  of  the  average  of  shots  520,  521  and 
522  is  shown  in  Fig.  6.  The  ratio  of  the 
second  to  the  first  peak  is  improved  to  0.307. 

A  portion  of  the  marine  seismogram  is  recon¬ 
structed  as  shown  in  Fig.  7.  Starting  from 
shot  423,  every  three  shot"  are  combined  by 
simple  averaging  and  then  linearly  filtered. 

For  each  combined  shot,  the  Walsh  transform 
of  the  first  1024  samples  is  taken.  This 
operation  requires  7  seconds  of  computer  time. 
The  inverse  transform  of  the  first  128  trans¬ 
formed  samples  is  then  obtained.  The  filtered 
sample  is  quantized  into  10  levels  with  the 
magnitude  increasing  from  1 jvel  0  to  level  9. 
Each  vertical  line  of  Fig.  7  corresponds  to 
one  combined  shot  with  each  filtered  sample 
represented  by  a  level  number  (level  0  is  not 
printed) .  The  time  difference  between  every 
two  adjacent  samples  la  15.6  msec.  The  computer 


time  for  processing  60  combined  shots  as  shown 
in  Fig.  7  is  11  minutes  and  48  seconds.  This 
includes  time  for  tape  reading,  compiling  (3 
minutes)  and  computation.  To  do  the  same  job 
using  FFT  requires  at  least  50  minutes.  Fig.  7 
indicates  the  rise  in  the  ocean  bottom  as  the 
distance  Increases.  The  multiple  reflection  is 
particularly  evident  as  the  water  depth  de¬ 
creases.  Finally  the  FFT  magnitude  and  the  FWT 
of  shot  522  are  shown  in  Figs.  8  and  9  respec¬ 
tively. 

Concluding  Remarks 

Walsh  transform  has  provided  us  with  an 
Important  computational  metnod  in  the  digital 
processing  of  marine  seismic  data.  The  improve¬ 
ment  "'f  FWT  over  FFT  in  both  computation  time 
and  u^.se  reduction  is  particularly  significant 
in  seismic  study.  Presently,  additional  Walsh 
filtering  techniques  and  deconvolution  using 
Walsh  function  are  being  examined. 
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Fig.  7  Reconstructed 
Marine  Seismogram 
(including  shots 
423  to  602) 


|  Fig.  8  Amplitude  Spectrum 

'  of  Shot  522  (obtained 

by  using  FFT) 


Fig.  9  A  Major  Portion  of  the  Walsh  Transform  for  Shot  522. 
(plotted  as  a  function  of  the  number  of  zero- crossings  per 
second  divided  by  two) 
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'  Abstract 

Tli i s  paper  describes  the  design,  implement¬ 
ation,  and  test  results  of  a  unique,  inexpen¬ 
sive,  all  digital  device  for  performing  the 
inverse  Walsh  or  lladamard  transform.  It  is 
suitable  for  operation  as  a  programmable  wave¬ 
form  synthesizer,  and  ultimately  as  a  speech 
synthesizer.  Ihe  inverse  transform  is 
performed  using  dominant  term  synthesis  rather 
than  ising  a  full  set  of  coefficient  values. 

Introduction 

Ihe  results  of  various  techniques  for  speech 
synthesis  presentee  by  Bozwetter  (1],  and 
Campanclla  and  Robinson  (2]  have  shown  that 
dominant  term  synthesis  of  speech  from  the 
Walsh  domain  was  possible,  and  with  fairly 
good  quality.  The  orthogonal  transform  showed 
promise  in  reducing  the  bit-rate  necessary 
for  intelligible  speech  communication  over  the 
usual  PCM  technique.  These  preliminary  results 
prompted  this  study  into  an  instrument  which 
would  acccp..  as  an  input  up  to  eight  dominant 
terms  in  either  the  Walsh  or  lladamard  domains, 
and  then  automatically  resynthesize  ti.e  wave¬ 
form  described  by  the  coefficients.  The  device 
uses  an  eight -word  data  storage  register  (each 
word  is  13  bits  in  length.),  a  single  "halsh 
or  lladamard"  function  generator,  one  6-bit 
rate  multiplier,  and  an  eight-bit  binary  up- 
down  counter  coupled  to  a  final  eigl.t-bit 
D/A  converter.  It  is  basically  a  special- 
purpose  computer,  designed  to  be  directly 
coupled  tc  almost  any  general  purpose  computer, 
or  can  be  controlled  manually  or  from  Read- 
Only  memories,  and  designed  to  act  as  a  function 
generator. 

Theory 

Being  orthonorral,  the  Walsh  and  lladamard 
functions  can  be  used  for  a  scries  expansion 
of  a  signal  (3]  .  The  functions  arc  orthonormal 
over  an  interval  of  time  9  and  have  the  value 
+1  or  -1.  Figure  1  demonstrates  the  relation 
between  the  lladamard  and  halsh  numbering.  The 
Walsh  senes  are  numbered  according  to  the 
"scqucncy"  of  the  function.  The  sequence  is 
related  to  the  number  of  zero  crossings  within 
9;  the  higher  the  sequence,  the  more  zero- 
crossings  (3).  Though  the  instrument  described 
here  can  perform  either  the  lladamard  or  Walsh 
inverse  transform,  only  the  Walsh  series 
representation  will  be  used  for  most  of  the 
explanations  to  simplify  the  presentation. 

The  Walsh  Scries  expansion  of  a  function 
fit)  is  defined  as  :< 

CO 

fit)  =  l  C(n)WAL(n,9)  (1) 

n=0 


where  C(n)  is  the  coefficient  of  the  nl  ‘  Walsh 
function  KAL(n,9).  Assuming  an  interval  of 
orthogonality  equal  to  unity,  any  specific 
coefficient  C(j)  may  be  determined  from  the 
following  relationship. 

rl 

CO)  =  i  f (t)WALO  ,9)d0  (2) 

>0 

Thus  the  coefficients  can  be  evaluated  by 
equation  (2),  and  the  original  waveform  fft) 
reconstructed  by  applying  equation  (1). 

For  real-time  analysis  of  signals, 
the  integral  on  the  right  side  of  equation  f ? 1 
can  be  approximated  by  a  finite  scries  by 
sampling  the  signal  f(t)  a  finite  number  of 
times.  If  the  signal  is  sampled  N  times  during 
the  interval  0  <  0  <  1  then  a  coefficient  C(j) 
can  be  approximated  bv  the  following  equation: 

•v  1  *N’-1 

C(j)  »  l  f  WALIj.O.)  (3) 

k=0  K  K 

where  f^  is  the  value  of  f(t)  at  the  k1*1  samp¬ 
ling  instant,  and  WAL(j ,0. )  is  the  value  of 
KAL(j,0)  at  the  k  1  sampling  instant.  This  leads 
to  the  discrete  inverse  transform  given  bv 
N-l 

f(t)  =  l  C(n)WAL(n,9)  (t) 

n=0 

Previous  work  (1,2)  has  shown  tiiat  not  all 
N  coefficients  need  by  used  in  the  restructuring 
of  f(t)  if  a  reasonable  error  can  be  tolerated. 
The  most  dominant  terms  tend  to  contain  the 
major  information  .Tor  speech  waveforms,  in 
particular,  dominant  term  synthesis  is  a  prom¬ 
ising  means  of  data  compression.  Data  compres¬ 
sion  is  carried  out  by  choosing  only  the  M  most 
dominant  terms  (in  absolute  value)  from  the 
complete  set  of  N  terms  used  in  a  discrete 
Walsh  transform.  The  final  generation  algorithm 
then  becomes: 

M 

f(t)  £  l  C.  WAl(k  ,6)  (5) 

n=l  n  n 

where  Cj.  is  the  n^1  most  dominant  coefficient 
sclcctea11  from  a  set  of  the  first  N  coefficient. 
Thc  value  of  M  must  be  chosen,  based  on  suitable 
criteria,  to  obtain  the  degree  of  accuracy 
desired,  as  must  N. 

Thc  number  X  was  chosen  to  he-  <>4 .  Ibis 
w. s  a  figure  based  on  published  results  of 
several  authors  (1,2)  which  seemed  to  indicate 
than  a  set  of  04  terms  might  contain  tiie  most 
information.  (Generally,  it  was  assumed  that 
thc  information-bea -mg  terms  arc  tnc  lower- 
rdered  scquency  terms).  Thc  update  frequency 

(corresponding  to  the  time  interval  $)  is  a 
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compromise  between  the  accuracy  of  the  generated 
waveform,  and  tho  numbor  of  coefficients  that 
must  be  produced  in  a  given  tine  interval. 
Uceauso  the  instrument  wa»  to  bo  used  ultimately 
as  a  speech  synthoaizor,  an  update  rate  of  S 
milliseconds  was  chosen  as  a  suitable  minimua 
update  rate.  Provision  Is  made  in  tho  instru- 
aent  to  vary  this  from  about  4  milliseconds  to 
over  19  hours  by  siapiy  varying  the  fundamental 
clock  frequency. 

The  next  parameter  to  be  evaluated  was  M. 
Prom  previous  work,  both  at  McMastcr  [4]  and 
by  bbgwcttcr  (1|,  a  value  of  8  for  M  was  deemed 
suitable,  finally,  tho  range  of  the  amplitude 
of  the  coefficients  was  chosen.  This  effect¬ 
ively  quantizes  the  Cv  to  a  predetermined 
accuracy.  'Iho  system  presented  hero  uses  only 
the  eight  most  dominant  terms  within  an 
analyzed  field  of  04  Walsh  coefficients.  With¬ 
in  this  set  of  the  eight  most,  dominant  terms, 
the  ratio  of  the  absolute  value  of  the  most 
dominant  to  the  least  dominant  coefficient 
(ignoring  any  zero-valued  coefficients!  for 
some  basic  waveforms  was  dotermined  (Fig.  2). 

As  can  be  scon  in  Figure  2  tho  maximum  ratio 
was  less  than  50:1.  Based  on  this  analysis, 
and  knowing  that  speech  is  reasonably  well 
synthesized  with  an  amplitude  error  of  up  to 
2  or  3  percent,  a  ratio  of  64  to  1  was  chosen 
for  the  coefficients.  This  produces  a  7 -bit 
designation  for  the  coefficient  amplitude 
allowing  for  the  sign  bit.  The  coefficient 
of  tho  jtl1  torm  can  havo  any  integral  value 
from  -63  to  +63. 

Design 

In  order  to  perform  the  mathematics  of 
equation  (S) ,  tho  final  system  must  be  capable 
of  handling  programmable  Walsh  function  inputs, 
multiplying  these  by  thoir  coefficient!!,  and 
then  adding  all  tho  torms  togothor.  Assuming 
that  a  programmable  Walsh  function  generator 
exists,  the  system  shown  in  Fig.  3  will  gener¬ 
ate  the  required  Walsh  series  reconstruction, 
bach  of  the  eight  Walsh  functions  arc  multiplied 
by  their  coefficients,  and  the  results  summed 
in  a  binary  adder.  The  sum  is  converted  to 
analog  form  by  a  final  D/A  convertor.  The 
process  Is  ropcatcd  each  time  any  of  the  Walsh 
functions  or  coefficients  changes  value.  The 

coefficients  and  the  Walsh  number  k  arc 
*n  n 

usually  periodically  updated  by  the  driving 
computer. 

This  system  is  not  yorv  efficient  in  terms 
of  hardware  complexity.  In  that  eight  distinct 
Walsh  function  generators  arc  required.  A 
multiplexing  system  using  one  Walsh  function 
generator,  and  ono  multiplier  to  sequentially 
produce  tho  required  torms  for  the  sum  is  sim- 
plor.  However,  tho  binary  adder  now  needs  a 
memory  element  In  it  to  store  the  partial  sums 
as  each  additional  term  Is  hoing  calculated. 
Since  tho  absolute  value  of  tho  Walsh  function 
is  always  unity,  Instead  of  tho  Walsh  function 
bolng  multiplied  by  Its  coefficient  before 
addlng,  tho  Walsh  function  value  (tl)  and  tho 
sign  of  the  coefficient  can  be  logically  com¬ 


bined.  If  tho  Walsh  function  and  the  coefficient 
Imvo  tho  same  sign,  thon  the  absolute  value  of 
tho  coefficient  can  bo  added  directly  to  the 
partial  sum  in  tho  binary  adder.  If  the  signs 
arc  different,  the  absolute  value  of  the  co- 
off  lciont  should  be  subtracted  from  the  partial 
sum  in  the  adder.  Figure  4  is  likely  circuit 
for  this  implementation. 

However,  tho  complexity  of  the  adder 
circuitry  has  increased  substantially  from  the 
first  system.  Tho  circuit  presented  in  Fig.  S 
is  the  novel  circuit  actually  used  to  produce 
a  simpler  system  than  that  of  Fig.  4.  The 
technique  used  converts  the  absolute  value  of 
the  coefficients  into  a  scrios  of  pulses.  For 
instanco,  if  equals  37,  then  thirty-seven 
pulsos  would  honproducod.  These  pulsos  arc 
then  simply  counted  in  a  binary  up-down  counter. 
The  direction  of  the  count  is  determined  by 
the  Walsh  function  generator,  and  the  sign  of 
the  coefficient.  By  using  such  a  system,  the 
complex  addcr-subtractor  with  memory  is  replaced 
by  a  binary  up-down  counter,  which  inherently 
contains  the  required  momory. 

Operation 

A  block  dingrm  of  the  final  apparatus  is 
given  in  Fig.  6.  The  circuit  that  converts 
the  absolute  value  of  the  coefficients  into  a 
string  of  pulses  is  the  rate-multiplier  [5], 
Basically,  the  rate  multiplier  is  a  device 
having  n  clock  input,  a  serios  of  r  control 
linos,  and  an  output.  A  binary  numbor  (C.k  ) 
is  placed  on  the  control  lines,  and  a  clock 
signal  of  frequency  fpn  is  placed  on  the  clock 
input.  Tho  output  consists  of  a  series  of 
pulses  having  a  frequency  fout  such  that: 

f  »  f.  .(a/b)  (6) 

out  in  ' 

where  a  is  the  binary  number  on  the  r  control 
lines,  and  b  *  2  . 

The  Walsh  function  generator  used  is  one 
proposed  by  Siemens  and  Kitai  f6| ,  and  modified 
to  also  generate  lladamard  functions. 

The  eight  input  storage  registers  arc 
loaded  sequentially,  either  directly  from  a 
computer,  or  manually  through  the  use  of  panel 
switches.  A  multiplexer  under  external  control 
is  used  to  determine  which  register  is  being 
loaded  with  the  data.  In  this  manner,  data  can 
he  loaded  independently  while  the  instrument 
is  performing  the  inverse  transform  from  the 
provlous  set  of  data. 

In  order  to  facilitate  the  handling  of 
positive  and  negative  numbers,  it  was  necessary 
to  havo  tiic  digital -to-analog  converter  centered 
in  its  range  for  a  zero  Input  signal.  This  was 
done  by  prosetting  the  binary  up-down  counter 
to  linlf-scalo.  Internally,  an  extra  4-blt 
counter  was  couplet!  to  the  basic  5-hit  up-down 
counter  to  allow  expansion  to  u  10-lilt  D/A 
converter  if  required,  and  to  act  as  a  scratch 
pad  for  intermtdiate  calculations  in  ease  of 
ovorflow.  Overflow  does  not  occur,  however. 
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Conclusions 


if  scaling  of  the  initial  coefficient  values 
is  such  that  the  sum  of  the  absolute  value  of 
all  the  coefficients'  amplitude  used  is  less 
than  127. 

The  input  word  for  eacii  storage  register 
is  organized  as  shown  in  Fig.  7.  The  13-bit 
word  required  for  each  dominant  coefficient 
includes  a  six-bit  portion  for  the  Walsh  function 
number,  and  a  7-bit  portion  for  the  coefficient 
amplitude  (one  bit  being  a  sign  bit). 

Results 

The  final  instrument  is  shown  in  Fig.  8, 
while  typical  outputs  arc  shown  in  Fig.  9. 
l'hc  outputs  in  Fig.  9  were  taken  directly  from 
the  D/A  coiv'crter,  and  shown  the  obvious  com¬ 
putation  frequency.  The  signals  synthesized 
were  periodic,  and  hence  there  is  no  change 
when  the  coefficient  values  arc  updated  every 
5  milliseconds.  For  non-periodic  waves,  a 
change  should  also  appear  corresponding  to  a 
frequency  of  about  200  llz.  Filters  should 
prevent  much  of  this  frequency  component  com¬ 
putation  frequency  component  (12.8  KHz.)  from 
appearing  at  the  final  outnut. 

An  error  analysis  shows  that  errors  occur 
mainly  in  two  ways.  Fi-st,  tlieie  are  math¬ 
ematical  errors  arising  from  using  a  truncated 
series,  f;om  quantizing  the  original  signal 
before  obtaining  the  coefficient  values,  and 
from  quantizing  the  coefficient  values  to  7  bits. 
Secondly,  there  arc  machine  errors,  namely  in 
the  D/A  converter,  the  finite  transfer  time 
from  the  up-down  counter  to  the  D/A  converter, 
the  calculation  time  (basically  1/04  of  the  time 
01  before  a  new  value  is  presented  to  the  D/A 
converter,  and  the  reset  time  of  the  counter 
before  performing  the  next  calculation.  Machine 
errors  t'ir.  the  amplitude  of  the  output)  are 
4  maximum  of  0.8",  while  q;if  tizing  of  tnc 
coefficient  amp1 .tudes  produces  an  error  of 
about  1.6"  maximum.  The  main  source  of  error 
appears  to  be  in  the  finite  length  of  the  scr¬ 
ies,  and  the  coefficient  truncation. 

'Ihc  error  in  the  sine  wave  shown  in  Fig.  9 
is  about  2%,  while  the  discontinuous  ramp  and 
triangle  produced  errors  of  less  than  IT.-  The 
pulse  wa/eforms  have  about  0.2"  error,  mainly 
duo  to  machine  limitations. 


Waveform 

Most  Dorn. 
Cocff.  (Abs. 
Value 1 

Least  Uom. 
Non-zero 
Cocff.  (Abs. 
Value) 

Ratio 

Sine 

63 

1.3 

48.5 

Triangle 

48 

3 

i6 

Ramp 

32 

l 

32 

Speech |ui 

36 

0 

3.6 

Fig.  2:  Ratio  of  Walsh  Coefficients  for 
.Scmc  Waveforms 


The  instrument  described  above  has  beei. 
built,  and  is  presently  being  interfaced  to 
a  FDP-8/L  computer  for  continuing  research  in 
speech  and  waveform  synthesis  under  computer 
control.  The  final  system  has  a  maximum 
frequency  response  of  about  8,000  llz.,  and  a 
minimum  of  1 .5  x  10"-'>  llz. 

Its  piactical  uses  include  a  low-frequency 
function  generator  (especially  for  ramps, 
triangles,  and  pulses);  or  as  a  special  purpose 
function  generator,  which  can  be  pro«rammed 
with  a  roan-only  memory;  or  (as  a  long  term 
goal)  a  useful  speech  synthesizer  for  coupling 
to  a  computer. 
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Fig.  1:  Walsh-liadamard  Relation  f,  Ordering 
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Sumcngry  re-alloeates  the  original  trmeelots  to  the 

characters.  The  nett  result  of  passing 

further  work  on  a  system  of  multiplexing  in  through  the  distribution  and  redistribution 

which  bim ry-aodula ted  ..alsh  functions  are  circuits  is  a  delay.  The  demultiplexer  - 

oun-iod  und  limited,  individual  channel  data  proper  cor Jdats  of  a  shift  register  with  normal 

boing  recovered  by  correlatin,  is  preseu.jd.  and  complimentary  outputs,  and  a  set  of  aojority 

In  particular,  a  method  of  extending  the  system  gates,  one  fer  each  channel.  The  j^*1  input  to 

is  indicated,  in  which  multiplexers  are  tha  i“*  majority  gate  is  connected  to  the 

concatenated.  normal  output  of  the  j*h  register  stago  if  the 

jth  character  of  the  i^  ./aluh  function  of  the 
Introduction  carrier  set  is  a  logical  1,  and  to  the  comp¬ 

limentary  output  otherwise.  Register  stages 
The  normal  mothod  cf  multiplexing  digital  ore  measured  Tro*  the  bock. 

.-ignals,  time  division,  is  inefficient  if  the 

load  factor  is  variable.  This  is  becauns  when  The  outputs  of  these  gates  are  then  held  in 

some  channels  are  not  in  use,  capacity  is  being  biddable  circuits  which  read  the  majority  gates 

wasted.  Inquiries  indicate  that  typical  mean  at  the  instant  the  received  frame  fills  the 

load  factors  (me an/ peak)  are  in  the  region  of  register,  as  determined  by  the  synch  circuitry. 

10  to  35  percent.  Since  most  systems  are 

designed  for  peak  capacity,  this  represents  a  Theoretical  and  experimental  results  for 

significant  wastage.  Recently  a  system  has  the  system  are  reproduced  in  fig.  2..  An 

been  described  in  ihich  the  spare  capacity  is  analysis  of  the  system  is  presented  in  the 

used  to  provide  constructive  redundancy  in  ouch  appendix.  For  the  present  we  note  that  the 

a  way  as  to  offer  error-protection  when  the  number  of  channels  which  may  he  used  depends 

system  is  not  fully  loaded,  aid  in  particular  upon  the  existence  of  a  matrix,  the  rows  of 

to  provide  a  tradeoff  between  the  number  of  which  display  a  sign-invariant  correlation- 

channels  in  use  and  the  degree  of  error--  coefficient  after  being  modulated,  summed  and 

protection  offered.  'This  system,  called  threshold-limited.  ,uch  a  matrix  is  the  set 


Gorrelation-Rocovered  Adaptive  Majority 
..ultiplexing  (CRAM:.)  is  extensively  discussed 
elsewhere  (Refs.  1,2,  3)  and  a.  few  details 
will  be  included  here,  since  the  pui;»se  of 
tiiis  paper  is  to  present  iona  thoore  cioal 
results  for  a  concatenated  version. 

A  diagram  of  the  system  is  shown  in  fig.  1, 
u  3et  of  .al3h  carriers  are  modulated  with 
binary  data  in  a  set  oi  modulo-2  gatos.  The 
./aloh  carriers  are  in  logical  1-0  form  witli  0 
corresponding  to  the  +1  and  1  to  the  -1  of  the 
normal  form.  A  modulo- 2  gate  is  thus  equivalent 
to  a  multiplier.  These  modulated  ifalsh 
functions  are  then  passed  to  a  majority  gate 
which  must  be  of  the  type  which  always  forms  a 
majority,  no  matter  how  many  inputs  are  presont. 

The  output  signal  consists  of  the  output 
from  this  majority  gate  plus  a  synchronising 
signal,  which  overvitee  one  of  the  timeslots 
of  the  .ialsh  carriers. 

The  timeslots  are  then  re-orderea  in  a 
circuit  called  the  distributor.  This  takes 
place  just  before  transmission  and  has  the 
effect  of  breaking  up  bursts  of  errors.  At 
the  demultiplexer,  a  corresponding  redistributor 


of  'alsh  functions  ..’al^(t)  to  '..'aly(t)  with  tho 
first  character  in  each  suppressed,  theca  have 
been  called  Truncated  b'alsh  functions  by  the 
authors.  Computer  soarcliea  indicate,  and 
Cough  has  shown  (4'  teat  such  matrices  of 
Walsh  functions  do  not  exist  for  order  Id  by  16 
or  greeter.  'The  original  ay. item  (refs  1,2,3} 
used  a  7  by  7  matrix,  and  a  typical  example  of 
a  signal  passing  through  the  system  is  indicated 
in  fig.  3. 

jncreasln^  th<  .  t>cr  of  channelc 

The  obvious  way  of  extending  the  system, 
namely  by  using  a  larger  matrix  is  thus  not 
available.  Other  methods  ihich  have  been 
considered  include  time  she ling  two  or  more 
such  systems  TDK-wise  in  a  longer  wordlength, 
which  will  of  course  extend  the  number  of 
channels  but  will  not  increase  the  error- 
protection. 

It  would  seem  a  pity  to  have  a  system  whose 
chief  feature  is  its  ability  to  adapt  to  a 
red ihed  load  by  increasing  the  errer-pre ^ec  t  ion. 
if  this  property  could  not  be  extended  .hen  the 
rystem  is  extended. 


The  only  rwr-ining  method  of  interest  is 
thus  concalcn  .tion,  for  vliich  the  output  of  ono 
multiplexor  is  taken  to  be  the  input  of  a  second 
multiplexor  and  oo  on.  Thus  each  succoo3ive 
demultiplexor  ’sees’  a  lower  error  rate,  and 
itself  reduces  this  rate. 

Figure  4  shows  the  general  idea,  and  the 
notation  employed. 

numbering  is  arranged  in  the  conceptual 
order  in  shich  a  signal  passes  throu^i  the 
multiplexor,  with  the  reverse  numbering  at  the 
demultiplexer,  such  that  a  demultiplexing 
stage  :dth  the  same  numbering  as  a  given 
multiplexing  stage  performs  the  inverse 
operation  to  the  latter.  The  first  level  of 
multiplexing  is  performed  with  the  multiplexers 
numbers  (l,l),(l,2),...(l,n);  the  final  stage 
of  demultiplexing  is  carried  out  with 
demultiplexers  similarly  numbered,  and  referred 
to  herein  as  the  first  level  of  demultiplexing, 
performing  as  it  does  the  inverse  operation  to 
the  first  level  of  multiplexing.  In  a 
similar  '.fay  the  second  level  of  multiplexing  is 
numbered  2.  The  k^1  input  of  the  jw*  multi¬ 
plexer  at  the  first  level  of  this  system  is 
labellod  l,j,k.  .'e  tom  this  mode  of 
connection  of  multiplexers  a  concatenation. 

In  the  transmission  path  a  device  to 
introduce  independent  errors  is  indicated, 
since  cs  will  i.e  explained,  -./a  consider  only 
the  prooability  of  a  given  character  being  in 
error. 

,!o  will  use  the  larms  'error  rate'  and 
'probability  that  a  given  character  is  in 
error'  a3  synonymous,  as  implied  by  Bernoulli's 
hypothesis  that  the  probability  nay  be  inferred 
by  the  average  ia-.e.  ..e  assjuao  that  all 
characters  have  the  same  probability  of  being 
in  error  of  p,  iniepen  iently  of  all  other 
errors,  this  in  turn  implies  that  any  tendency 
towards  burs  ts  of  errors  ha3  boon  c cun to rod  by 
fur  example ,  reordering  the  characters  of  the 
3ignul  in  the  time  domain  be  fore  transmission, 
and  performing  the  inverse  operation  alter 
transmission.  .if tor  the  addition  of  errors, 
the  error  rate  is  p  witn  0  <p<l.  It  is  shown 
(in  the  appendix  and  refs.  1,  2  and  3)  that  for 
small  error  rete3,  there  exists  a  simple 
relationship  f(p)  between  the  3ignal  error  rate 
p  end  the  channel  error  rate  ?  where  P  is  the 
probability  that  there  will  be  a  discrepancy 
between  the  input  character  into  tho  multi¬ 
plexor  on  a  given  channel  in  a  given  timeslot, 
and  the  corresponding  character  from  tho 
demultiplexer.  Thus  P  =  f(p) 

Let  the  output  error  reie  in  the  stream 
fforn  the  uenultip lexer  labelled  2  (second  level 
of  demultiplexer  in  the  sente  described 
earlier)  be  given  by  p'  »  f-.(p).  Then  this 
error  rate  is  the  input  error  rate  into  the 
next  (or  first)  level  of  demultiplexing. 


,/e  have  assumed  that  signal  orroro  are 
independent,  end  thus  blocks  of  characters  nay 
be  taken  a3  independent  with  regard  to  the 
probability  of  obtaining  a  susceptible  error 
pattern.  Theso  blocks  correspond  to  characteru 
for  each  of  the  demultiplexers  at  the  first 
level,  arid  thus  statistical  independence  is 
maintained  at  the  first  lovel.  Let  the 
relationship  between  input  error  rate  p’  and 
output  error  rate  p"  for  tho  first  level  of 
demultiplexing  be  given  by  p"  =  f.(p'),  then  we 
nay  say  that  . 

P"  »  \(f2(p)) 

\. 

I  low  the  relationships  f.  and  S.  are  of  the 
form  \ 

f(p)  =  kpx  and  we  hoto  that 

fx  (f2(p))  t  ^(^(p)). 

unless  the  k's  and  tho  x'c  are  related. 

row  the  k*3  and  x'a  are  functions  of  the 
number  of  channels  in  use  at  one  line,  and  thus 
if  all  tho  multiplexors  are  identical,  and  all 
tho  demultiplexors  are  i.donticul,  it  makes  a 
difference  to  the  overall  error  performance 
whether  nj  charnels  are  multiplexed  at  each 
first  level  multiplexor  of  which  there  are  n2, 
or  vice  versa.  An  example  '.till  make  the 
foragoing  clear.  Impose  that  both  multiplexer 
demultiplexer  at  both  levels  aro  of  the  ?  input 
type  03  has  boon  described  ol3ewhore.  Lot  the 
first  level  of  multiplexing  bo  carried  out  with 
all  seven  channels  in  use  and  the  second  using 
throe  such  multiplexed  inputs.  The  input/ 
output  error  relationship  for  a  fully  loaded  7 
chunnel  system  is  f(p)  =  2.2p,  and  for  a  7 
channel  3y ,  '.on  loaded  with  three  channels 
f(p)  =  7.5p^»  ?hc3e  ros-ltc  aro  derived  in 
tho  ap.enrlix.  '.'hue  we  have  fp(p)  =  2.2p  and 
f2(p)  =  7.5pZ  which  'ivosi 

fx(f2(p))  =  2.2(7.5P2)  =  16.4P2 

If  ho  :  ever  the  first  lovel  had  used  oidy  throe 
channels  por  uvl  tipi  ex  or  slid  tho  second  lovel 
had  v.  ed  7  inputs,  tho  .nine  number  (namely  2l) 
channels  would  have  been  ■icco:viodated  but  we 
would  have  f^(p)  =  7.5p2  and  f2(p)  =  2.2p  giving 

fx  (f2(p>)  =  7.5(2.2p)2  =  55.9P2 
which  is  about  twice  tho  previous  rat o. 

Y  J 

If  we  lot  fj(p)  =  kj,p  and  f2(p)  =  k2p  2 
thon  we  have 

f1(f2(p)>  »  1\(!c?_p"2)X1  =  k^1  v1*2 
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The  orror  rolatiomiiip  for  TDII  is  f(p)  =  uaixy, 
thus  if  one  of  the  nultiplcKoro  is  TDK  it  is  ns 
if  there  were  no  concatenation. 


and  f2(fx(p))  =  k^k^p  1)  2  -=  ^p*1  2 


and  we  ooe  that  in  general  chese  are  not  equal 
since  unleoo  either: 

=  k2  or  x^  -=  x2  =  1  we  have 

*  h\ 

Those  results  are  summarised  in  table  1  ibr  tho 
7  channel  syoten.  In  this  tablo  ths  rows 
refer  to  the  first  level  a"d  the  columns  to  the 
second  level.  In  the  fir.  „  row  and  column  are 
includod  tho  TJli  case,  fbr  reforence  purposes. 


The  same  results  are  ixresentod  graphically 
in  fig.  5. 


The  authors  would  like  to  tliank  tho  Director, 
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of  Tefonce  (frocuronent  hcocutivo). 


Table  1 

Error  rates  for 
concatenated  system 


_-lai _ 

TDM 

7  chans 

3  chans 

1  cnan 

TDM 

P 

2.19p 

7.5p2 

35P1* 

7  channels 

2.19p 

2.19(2.19p) 

2.19(7. 5p2) 

3  channels 

7.5p2 

7o(2,19p)2 

7.5(7.5p2)2 

T.S(35f*)8 

1  channel 

35p** 

35(2.i9p)U 

35(7. 5P2)1* 

35(35pV‘ 

\8nd 

1st 

TDM 

7  chans 

3  chans 

1  chan 

TDM 

P 

2.19p 

7,5p2 

35pU 

7  channels 

2.19? 

l».78p 

l6,hp2 

l6.6p* 

3  channels 

7.5p2 

35. 9p2 

!<21.9p** 

9187.5P8 

1  channel 

35P*4 

STl.ltp1* 

110  ?l*2.2p8 

52  521  875.0plS 

WK'1.'"  J  V‘  ^  ^ 

*  r  l 


nr,T?4?"$  «sqf  Ti&t^W 


•y't  M 

'  ■  •■*.'  ■ 
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.10  consider  a  set  of  code  .ordo  A  such  that 
&}j  is  the  jth  character  in  the  i"1  ccdoword. 

The  number  of  diameters  in  each  codeword  is  L 
and  there  are  n  codewords*  Thus  T  is  an  n  by 
1.  matrix.  Let  have  the  two  possible 

values  ±  1.  Let  D  be  a  colu::n  vector  of  n 
components  each  ofjfhich  my  have  one  of  the 
two  values  -  1.  3  will  be  called  the  data 

vector.  The  vector  T3  =  has  as  its 
component  the  sm  of  the  j”1  components  of  the 
codewords,  each  weighted  by  the  data 
appropriate  to  it.  ..'o  define  the  opomtor 
’sills’  to  have  the  effect  of  roplacing  a 
vector  by  another  vector  whoso  components  are 
tile  signs  of  tliose  of  the  original  vector. 

The  signal  transmitted  by  the  C.U. ..  system 
is  thus: 

S  -  signs  ("3)  =  siyis  D^k 

The  demultiplexer  finds  the  correlation 
coofficicnts  of  thi3  signal  with  each  of  iho 
codewords.  The  column  vector  of  such 
correlation  coefficients  i3  given  by 

T  a  ii!*  =  A( signs  (D^a)* 

and  the  co.  •  ■>  vector  of  recovered  data  is 
giver,  by  th.  .lgns  of  theoo  correlation 
coefficients: 

h’  =  signs  (A(signs(3*A)*) 

It  will  bo  obsorvod  that  the  notation  lia3  been 
chosen  inch  that  events  which  tul:e  place 
serially  such  as  tile  transmitted  signil,  aro 
represented  by  row  vectors,  and  simultaneous 
events,  such  as  the  input  of  data,  by  column 
vectors,  thus  in  all  these  matrices,  ’timo’ 
goe3  horizontally. 

Jo  define  the  column  vector  R  to  bo 

it  =  OdiaEAsigns(DtA) 

wlv.-ro  i)^  lias  as  it  ii**1  component  the  data 
d^,  and  zeros  everywhere  olse.  Thus  if  r^  is 
positive,  tho  recovered  data  or*  the  I**1  channel 
i3  the  same  as  tliat  at  the  input,  and  there  is 
no  error,  it  has  been  called  the  ’reassurance 
vector’  and  r.  tho  reassurance  on  tho  1th  __ 
channel.  Ir  one  churactor  in  tlio  signal  3 
is  altered,  t'.o  oassuruncos  on  oach  chanroa  will 
chan, go  by  -  2 . 

Thua  area3suranco  of  2t+l  is  a  guarantee 
of  protection  against  t  errors. 

Lot  n  be  the  number  of  characters  in  a 
—  P 

3j.g1.al  :j  which  contribute  positively  to  r^  and 


nn  be  tlie  number  which  contribute  negatively. 

To  begin  with  we  have  n  +  n  =  L 
p  n 

and  in  addition,  by  the  choice  of  the  partition 
of’ tho  characters  we  have 


Thus  we  got 

np  =  '^ri+L) 

'..e  now  consider  two  cases  depending  on  whether 
L  i3  even  or  odd,  (actually  in  the  case  to  which 
most  attention  ha3  boon  given  (1,2,3)  L  =  7  is 
odd ) . 


The  addition  of  an  error  to  ono  of  the  n 

positively  contributing  characters  will  reduce 

n  and  increase  n  by  one,  and  thus  reduce  r. 
p  n  i 

by  two.  .o  nay  add  errors  until  r*  is  reduced 

to  a  negative  number,  in  which  case  a  channel 

error  will  result.  The  number  of  errors  which 

may  be  so  addod  is  ^(r*-l),  and  the  addition  of 

ono  more,  namely  -Hr^+l)  errors,  could  load  to  a 

channel  error  providing  all  tho  signal  errors 

occur  among  the  n  positively  contributing 

characters.  'Jo  Say  that  the  channel  is 

susceptible  to 

X  =  'Hri  +  l)  errors. 

On  the  assumption  that  tho  most  liKoly  source  of 
channel  errors  is  that  which  requires  the  least 
number  of  signal  e  row,  namely  when  exactly  x 
signal  errors  occur  in  a  signal  3uch  that  the 
iw  channel  is  susceptible  to  x  errors,  we  nay 
say  that  the  probability  that  exactly  x  errors 
\:ill  occur  among  the  n^  positively  contributing 
characters  is 


(M  f  (» 


and  the  probability  that  an  arbitrary  word  is 
susceptible  to  x  errors  i3  L'x/2n  on  the  given 
channol.  Thon  the  moot  likoly  source  of  errors 
is  a  data  vector  of  least  susceptibility. 

Lot  I!  .  bo  tho  number  of  data  vectors  of  least 


susceptibility  x_._. 

ciin 


The  probability  of  error  in  the  iT 
given  by: 


channol  is 


' 


*i  ■  ^  ^ 

where  Vn  =  -Kr^  L)  and  =  T(rfflin  +  l) 

and  r  ,  is  the  lea3t  reassurance  on  the 
Bin 

channel. 

L  even 

Here  the  nuaber  of  errors  to  .--dues  ^  to 
2ero  is  -j-r^  provided  they  occur  in  the  np 
positively  contributing  characters.  .;'e  assume 
that  the  majority  gate  will  be  designed  to 
round  upwards  of  downwards  for  50-50  divisions, 
and  so  half  of  these  cases  will  lead  to  error. 


In  order  to  evaluate  thoso  formulae  it  is 
necessary  to  have  a  table  of  re assurances  for 
all  input  data  vectors.  this  information  i3 
best  provided  by  computation  and  the  nett 
result  is  that  for  the  throe  cases  considered 
(one,  three  and  seven  channels  in  use)  we 
obtain  the  following  results: 


limber  of  channels 
in  use 

7 

3 

1 

References 
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2.19P 


7.5P 

:5P4 


Otherwise  the  argument  is  identical  to  the 
case  for  n  odd. 


P 


x 


P 


with  nttin  =  t(rnin  +  L)?xnin  . 

and  rm<n  is  the  least  reassurance 
channel. 


^rmin  +  1} 
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RESULTS  OE  MULTIPLEXING  EXPERIMENTS  USING  WALSH  [■'('NOTIONS 


by  David  I.  Durst 
Grumman  Aerospace  Corporation 


Abstract 

An  investigation  was  conducted  to  study  the  use 
of  Walsh  functions  as  orthogonal  carriers  in  both  an¬ 
alog  and  digital  multiplexers  for  several  of  G rum- 
man’s  eh  ctronic  development  projects.  An  analog 
multiplexer,  relying  heavily  on  the  use  of  integrated 
circuits,  was  constructed  and  tested,  revealing  en¬ 
couraging  simplicity  of  implementation,  while  point¬ 
ing  out  various  circuit  deficiencies  which  restrict 
system  performance.  A  digital  system,  based  upon 
an  adaptive  majority  multiplexing  scheme,  was  sim¬ 
ulated  on  a  digital  computer.  The  data  which  was 
obtained  concerning  the  distribution  of  sequence 
power  can  be  of  value  in  influencing  the  choice  of 
Walsh  carriers  to  be  used  in  this  svstem  and  gives 
insight  into  the  nature  of  certain  deterministic  er¬ 
rors  involved  in  system  operation. 

Introduction 

The  Grumman  Aerospace  Corporation  is  active 
in  a  number  of  areas  of  electronic  development  which 
could  benefit  from  the  use  of  Walsh  functions.  These 
i.ielud-  interior  multiplexing  of  data  and  control 
signa1  board  aircraft  where  cable  weight  is  a  s:g- 
ni  ■  s-,m  factor,  high-speed  computer  pro¬ 


cessing  of  transforms,  file  enhancement  and  com¬ 
pression  of  surveillance  photogi aplis,  and  naviga¬ 
tional  Kinging  using  lime- shill  dependent  spectia. 
Multiplex  systems  arc  om  greatest  interest  at  this 
time.  This  paper  deals  with  an  evaluation  ol  a  pro¬ 
totype  Walsh  function  analog  multiplex  svstem,  and 
results  of  a  computer  .simulation  of  an  all  digital, 
adaptive  majoritv  multiplexing  technique. 

Analog  Multiplexer 

The  analog  svstem  whose  i.iocK  diaginm  is 
shown  in  Figure  1,  is  capable  of  nr  lulating  up  io  Hi 
band-limited  signal  channels  onto  i.  t  of  Walsh 
carriers  lor  transmission  over  on-  one,  ami  recon¬ 
structing  the  signals  at  the  receiving  end.  While 
only  two  channels  have  b«-en  activated  and  tested, 
complete  13-channel  operation  can  be  achieved  bv 
the  addition  of  several  redundant  analog  eircu.t 
hoards.  The  multiplexer  was  designed  and  built  lor 
evaluation,  study,  and  demonstrations.  Photographs 
of  the  complete  svstem  are  shown  in  Figure  2. 

The  system  was  constructed  ,  ntirelv  ol  rcadilv 
available  digital  and  linear  integrated  circuits.  The 
Walsh  function  generator,  consisting  ol  a  clock  os¬ 
cillator,  binary  counter  and  exclusive  -or  logit  gates, 


Seqiitncy4l 

r 

Walsh 

Filter  | 

Multiplier 

Sample  n 

*  n 

,  t 

Dschrg  O 

Sequency 

1 

Walsh 

Filter 

Multiplier 

Wal  (K.t)  • 


WaUi  1^ 
Muitipliei 


Sequency 

Low-Pass 

Filter 


Walsh  i _ J  ?^u 

Multiplier  |  ^  Low 

— ar  — 

-  ■  .1  Samnle  - _ 


Sequency 
Low  Pass 
Filter 


Sample  & 
Discharge 
Logic 


Walsh 

Function 

Generator 

Logic 


Wal  {0,  t) 
Wal  0.  t) 

Wal  05,  t) 


I  Sync 
1  Extractor 


Sample  - ►  Sample 

8t  Discharge 

Logic  - ►Discharge 


h  - ►  Wal  (0,  t 

etion  - ►  Wal  0,  t] 

c  - Wai  05.  t) 


Walsh 

Function 

Gen 

Logic 


Fit;.  1  Walsh  Function  \nnIo<*  Multiplexer 


was  fabricated  from  standard  7 400  series  TTL  dig¬ 
ital  logic.  The  analog  processing  is  completely 
performed  by  LM201  operational  amplifiers  and 
DG141  analog  switches.  The  system  clock  frequen¬ 
cy  was  selected  to  produce  a  150  microsecond  ortho¬ 
gonality  Interval  for  the  Walsh  functions,  thus  pro¬ 
viding  a  theoretical  input  bandwidth  for  the  system  of 
approximately  3  KHz  (usable  for  intelligible  voice 
transmission).  Some  oscillograms  of  representative 
system  waveforms  are  shown  in  Figure  3. 

It  is  of  interest  to  note  that  by  pushing  the 
7400  series  of  digital  logic  to  its  maximum  speed 
capability,  it  is  possible  to  generate  the  16  low- 
order  Walsh  functions  with  an  orthogonality  interval 
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Fig.  3  Oscillograms  of  Representative  System 
Waveforms 


WALSH  FUNCTION  MULTIPLEX  SYSTEM 


XMTP  MBVW 


(b) 

Fig.  2  Photographs  of  Prototype  Analog  System 


as  small  as  0. 5  microseconds,  or  a  maximum  se- 
quency  of  30  Mega  zps.  Neglecting  analog  circuit 
limitations,  the  maximum  frequency  bandwith  of  the 
input  signals  could  be  as  high  as  1  MHz.  Futher- 
more,  using  state-of-the-art,  emitter-coupled  inte¬ 
grated  logic  circuits,  such  as  the  Motorola  MECL 
III  family,  sixteenth-order  Walsh  functions  can 
readily  be  generated  with  orthogonality  intervals  as 
low  as  25  nanoseconds.  This  corresponds  to  a 
maximum  input  frequency  bandwith  of  20  MHz.  The 
linear  integrated  circuits  which  are  available  for 
our  analog  circuit  requirements  severely  limit  the 
operating  sequency  of  this  multiplexer.  This  is 
described  later. 

Performance  Data 

An  important  performance  parameter  in  a 
multiplex  system  is  crosstalk  between  channels. 
Measurements  were  made  to  determine  the  magni¬ 
tude  of  the  crosstalk  in  this  system  for  all  possible 
combinations  of  16  Walsh  function  carriers.  It  was 
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found  that  the  degree  of  crosstalk  is  strongly  de¬ 
pendent  upon  the  sequeney  of  the  Walsh  function 
carrier  selected  for  each  channel,  with  the  magni¬ 
tude  varying  between  -13  db  and  -45  db.  Figure  4 
shows  how  the  crosstalk  in  a  channel  increased  as 
the  sequeney  of  the  adjacent  channel  carrier  was 
increased.  An  increase  in  the  amplitude  of  the  in¬ 
put  analog  signals  was  also  found  to  increase  the 
crosstalk,  although  a  change  in  signal  freque^  V  had 
no  effect,  thus  eliminating  the  possibility  tht.  apac- 
itive  coupling  between  channels  was  involved. 

The  total  harmonic  distortion  of  the  output  sig¬ 
nals  introduced  by  the  multiplexer  was  found  to  be  a 
function  of  the  sequeney  of  the  Walsh  function  car¬ 
rier  selected.  As  shown  in  Figure  5,  the  percer  ‘ 
harmonic  distortion  of  a  100Hz.  input  signal  was 
found  to  vary  from  .8%  for  a  wal  (0,1)  modulated 
carrier  to  2%  for  the  wal  (15,  #)  carrier.  All  dis¬ 
tortion  measurements  were  made  with  a  3-kHz 
single-pole  low-pass  filter  in  cascade  with  the  out¬ 
put  to  eliminate  the  high  frequency  sampling  har¬ 
monics  inherent  in  the  multiplexer. 


Fig.  5  Percent  Harmonic  Distribution  of  100  Hz 
Sinusoid  as  a  Function  of  Walsh  Carrier 
Sequeney 


Synchronization 


Due  to  the  nature  of  the  correlation  function 
of  the  Walsh  functions,  precise  phase  synchroniza¬ 
tion  between  the  multiplexer  and  demultiplexer  is 
essential  to  proper  system  operation.  In  order  to 
observe  the  effects  of  phase  shift  in  the  prototype 
multiplexer,  we  provided  an  external  synchroniza¬ 
tion  link  capable  of  varying  the  phase  between  the 
two  Walsh  function  generators  in  precisely  con¬ 
trolled  increments.  Figure  6a  shows  a  graph  of  the 
amplitude  gain  through  one  channel  of  the  multiplex 
system  as  a  function  of  the  phase  shift  between  the 
cal  (7,1)  carriers.  A  similar  graph  for  the  sal 
(1,  t )  carrier  is  shown  in  Figure  6b.  Each  mea¬ 
surement  was  made  with  a  step  change  in  phase  of 
1/6 4th  of  the  orthogonality  interval.  The  graph  is 
representative  of  the  absolute  magnitude  ot  the  auto¬ 
correlation  function  of  the  carrier  and  agrees  with 
theoretical  results.  Increases  in  crosstalk,  with 
phase  shift,  of  up  to  10  db  were  also  observed. 


ActiwChtnnd  Scqumcy 

Fig.  4  Crosstalk  in  Designated  Channel  as  a 
Function  of  Adjacent  Channel  Sequeney 
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Fig.  6  Multiplexer  System  Gain  as  a  Function  of 
Walsh  Generator  Phase  Shift  Between 
Transmitter  and  Receiver 
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For  higher  sequency  Walsh  functions,  a  very 
slight  change  in  phase  can  result  in  a  significant 
change  In  channel  output.  As  an  example  consider 
the  cal  (7, 9 )  function  with  an  orthogonality  Interval 
of  1  microsecond.  Figure  6a,  shows  that  a  synchro¬ 
nization  error  of  as  little  as  16  nanoseconds  (1/C4 
period)  can  result  In  a  20  db  change  in  received 
signal  output.  As  the  sequency  of  the  carriers 
which  this  multiplexer  is  designed  to  handle,  in¬ 
crease,  precise  control  of  titne  delays  through  the 
synchronization  circuits  becomes  critical. 

Analog  Circuit  Restrictions 

The  degree  to  which  the  modulated  sequency 
carriers  within  the  multiplexer  circuits  approach 
perfect  Walsh  functions  is  an  important  factor  in 
explaining  previously  mentioned  deficiencies  in 
system  operation.  Although  good  quality  Walsh 
functions  can  be  synthesized  digitally,  the  ability  to 
perform  multiplication  and  addition  operatioos  with 
these  functions  requires  linear  devices  which  can 
slew  between  voltages  of  opposite  polarity  in  zero 
time.  Such  impractical  devices  would  be  optimized 
in  the  sequency  domain.  In  order  to  approach  this 
optimum  devicewith  practical  hardware,  the  prop¬ 
erties  of  frequency-domain-optimized  linear  am¬ 
plifiers  can  be  combined  with  time-do  main-opti¬ 
mized  electronic  switches,  The  multiplier  configu¬ 
ration  shown  in  Figure  7  is  an  example  of  this.  This 
circuit  which  was  used  in  our  prototype  system 
multiplies  the  wai  (0,»)  component  of  the  input  ana¬ 
log  signals  by  a  selected  Walsh  carrier  by  switching 
the  amplifier  from  an  inverting  to  a  non-inverting 
mode  in  step  with  a  digital  control  signal. 

It  Is  desirable  to  use  an  operational  amplifier 
in  this  curcuit  for  precise  gain  control  and  frequency 
control  characteristics.  Modern  integrated  circuit 
ope  rational  amplifiers,  however,  ore  limited  to 
slew  rates  of  approximately  100  volts  per  micro¬ 
second  at  unity  gain.  Furthermore,  integrated 
analog  switches  have  maximum  speeds  of  the  order 
of  one  microsecond,  and  non-symmetrlcal  turnon 
vs  turnoff  delays  of  approximately  500  nanoseconds. 
Because  of  these  analog  circuit  limitations,  the 
multiplexer  in  multiplying  two  near-perfect  Walsh 
functions  produces  a  distorted  Welsh  function  having- 
much  longer  transition  times.  This  is  a  direct 
result  of  the  degradation  in  performance  Involved  in 
tue  interface  between  high-speed  digital  logic  with 
limited-slew- rate  linear  circuitry. 
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Fig.  7  Waish  Function  Multiplier.  Combination 
of  Linear  Amplifier  and  Electronic  Switch 


In  an  effort  to  preserve  the  orthogonality  of 
the  Walsh  functions,  it  is  necessary  to  reduce  the 
maximum  sequency,  so  that  the  finite  transition 
times  are  a  small  fraction  of  the  orthogonal  interval. 
This,  of  course,  reduces  the  sampling  frequency  of 
the  sequency  low-pass  filter,  thus  limiting  the  maxi¬ 
mum  frequency  bandwidth  of  the  input  signals. 

As  was  previously  mentioned,  the  percent 
harmonic  distortion  of  the  input  signal  channels 
processed  by  the  multiplexer  and  the  crosstalk  be¬ 
tween  multiplexer  channels  will,  in  general,  in¬ 
crease  as  the  sequency  of  the  carriers  increase. 

This  is  in  line  with  the  sequency  limitations  of  the 
WaJsh  multiplier  and  other  linear  circuits  used  in 
this  multiplexer.  Furthermore,  the  increase  in 
crosstalk  with  increases  in  the  amplitude  of  the 
multiplexer  input  signals  is  related  to  the  higher 
voltages  to  which  the  Walsh  multiplier  must  slew. 

The  correspondingly  longer  transition  times  of  the 
modulated  Walsh  function  result  in  a  cross-cor¬ 
relation  function  in  the  demodulation  process  which 
is  increasingly  greater  than  zero,  thus  producing 
higher  levels  of  crosstalk.  Amplitude  comnression 
and  limiting  of  the  multiplexor  input  signals  will 
reduce  the  voltages  to  which  the  linear  amplifiers 
must  slew.  This  compromise  can  be  used  to  re¬ 
duce  crosstalk  level  when  faster  slew-rate  ampli¬ 
fiers  are  unavailable. 

These  experiments  and  observations  with  the 
prototype,  have  reaffirmed  the  feasibility  of  con¬ 
structing  a  multiplex  system  using  amplitude- 
modulated  Waish  functions,  rather  than  sinusoidal 
functions.  However,  certain  deficiencies  in  avail¬ 
able  Integrated  circuit  performance,  impose 
various  restrictions  on  the  system  design.  While 
Walsh  functions  of  sequency  greater  than  100  Mega 
zps  can  readily  be  synthesized  using  state-of-the- 
art  digital  circuits,  the  linear  integrated  circuits 
which  can  modulate  these  functions  and  preserve 
their  orthogonal  properties  are  severely  speed 
limited  in  comparison. 

Further  improvements  in  linear  integrated 
circuits  will  certainly  enhance  the  performance 
possibilities  of  Walsh  function  multiplexers.  It 
should  be  noted,  however,  that  In  any  applica¬ 
tion  where  multiplication  by  an  analog  signal  is 
involved,  the  inherently  binary  Walsh  functions 
are  immediately  transformed  into  a  multilevel 
analog  signal,  and  oil  further  processing  must 
be  done  by  linear  circuitry.  A  much  more  desir¬ 
able  application  of  Walsh  functions  would  retain 
their  binary  structure  throughout  all  stages  of 
processing,  and  thus  make  more  efficient  use  of 
their  properties.  Suck  an  all  digital  system  is 
discussed  below. 

Digital  Multiplexer 

Barrett  and  Gordon  [l]  have  described  an 
adaptive  majority  multiplexing  scheme  in  which 
several  channels  of  binary  data  are  multiplexed  by 
modulation  onto  the  seven  lowest-order  Walsh  func¬ 
tions.  Each  bit  of  binary  ingot  data  is  represented  in 
terms  cf  the  wai  (0,#)  function,  with  a  logic  "zero'1 
designated  as  +  wai  (C,  » )  and  logic  •’one"  desig¬ 
nated  as  -  wai  (0,  # ).  If  the  logic  level  for  each 
input  channel  is  multiplied  by  its  respective  Walsh 
carrier,  and  the  products  are  algebraically  added, 
the  system  would  be  identical  to  the  linear  system 
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FIs.  8  Adaptive  Majority  Multiplex  System 


previously  described.  This  linear  superposition 
of  Walsh  functions  can  be  hard-limited  by  a  major¬ 
ity  gate  before  transmission  [1J .  The  resulting 
binary  signal  will,  in  most  cases,  still  contain 
separable  input  logic  information  for  each  channel. 
It  has  been  shown  that  such  a  multiplexing  system 
is  then  capable  of  providing  automatic  tradeoff  be¬ 
tween  its  redundancy  properties  and  the  number  of 
channels  in  use  at  one  time. 

The  digital  multiplexer  shown  in  the  block 
diagram  of  Figure  8  can  be  built  entirely  of  digital 
integrated  circuits,  thus  enabling  high-speed 
operation.  Exclusive  OR  logic  gates  can  be  used 
as  Walsh-function  multipliers  and  the  adaptive 
majority  gate  can  easily  be  implemented  with  a 
256-bit  read-only  memory  chip.  In  fact,  it  is  con¬ 
ceivable  to  implement  the  entire  multiplexer  or  de¬ 
multiplexer  circuitry  with  one  read-only  memory 
and  a  shift  register. 

Computer  Simulation 

A  computer  simulation  of  this  system  was 
performed  in  an  effort  to  study  an  inherent  deter¬ 
ministic  error  £l]  ,  and  to  determine  the  sequen- 
cy  power  distribution  of  the  multiplexed  signal. 

The  computer  program  simulated  actual  system 
operation  with  from  one  through  seven  channels 
active  at  any  one  time  and  with  all  possible  input 
logic  combinations  genera. and  tested. 


The  computer  was  programmed  to  calculate  the 
results  of  each  step  of  the  adaptive  majority  multi¬ 
plexing  process,  and  makes  a  bit-for-bit  comparison 
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between  the  binary  levels  selected  at  the  input  and  the 
resulting  levels  calculated  at  the  output.  If  a  match 
is  found,  a  new  word  is  calculated  and  the  process  is 
repeated  until  all  possible  binary  bit  combinations  are 
exhausted.  If  an  error  Is  detected  in  any  output  bit 
channel,  a  warning  message  is  printed,  indicating 
the  calculated  output  results  containing  the  error,  the 
corresponding  input  binary  bits,  and  a  representa¬ 
tion  of  the  Walsh  sequency  spectrum  of  the  multi¬ 
plexed  signal.  When  all  possible  input  combinations 
for  a  given  number  of  active  channels  is  exhausted, 
an  additional  channel  is  activated  and  the  process  re¬ 
peats  until  all  seven  channels  are  activated  and 
checked.  The  designation  of  the  sequency  of  each 
Walsh  carrier  per  channel  is  provided  as  input  data 
for  each  run.  It  should  be  noted  at  this  point  that  for 
synchronization  purposes  in  a  practical  system,  the 
first  time  slot  of  each  orthogonal  interval  of  the  multi¬ 
plexed  signal  is  truncated  and  forced  to  a  logic  "one". 
The  computer  program  uses  this  truncated  signal  but 
there  is  little  difference  in  the  final  results  whether 
the  signals  are  truncated  or  not. 

Computer  Results 

The  system  operates  satisfactorily  when  the 
number  of  active  channels  is  either  one,  two,  three, 
six,  or  seven.  When  five  channels  are  active,  deter¬ 
ministic  errors  are  generated  for  certain  combina¬ 
tions  of  input  logic  levels.  This  is  true  for  all  pos¬ 
sible  choices  of  five  out  of  seven  Walsh  carriers. 

Each  of  the  21  possible  combinations  of  five  carriers 
were  tested  by  the  computer  program.  Each  run 
showed  similar  errors  in  the  output  binary  bits.  For 
the  four-channel  case  it  was  possible  to  choose  sever¬ 
al  combinations  of  four  Walsh  carriers  such  that  the 


multiplex  system  operated  without  any  deterministic 
errors.  A  list  of  three  sets  of  Walsh  function  car¬ 
riers  which  can  be  used  when  only  four  multiplexer 
channels  are  operative  is  presented  in  Table  1.  Time 
limitations  prevented  a  check  of  all  42  possible 
choices  of  four  carrier  sets. 
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TABLE  1  THREE  SETS  OF  WALSH  FUNCTIONS, 
SUITABLE  FOR  FOUR-CHANNEL 
MULTIPLEXER  OPERATION 
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Majority  Multiplexer  Spectral  Analysis 


The  computer-derived  spectral  analysis  of  the 
multiplexer  output  signal  indicates  a  spreading  and 
shifting  of  the  spectrum  of  the  signal  as  it  passes 
through  the  majority  gate.  This,  of  course,  should 
be  expected  since  the  majority  gate  effectively  re¬ 
ceives  a  multi-level  superposition  of  Walsh  functions 
at  its  input  and  performs  a  hard-limiting  operation  on 
it  to  produce  a  binary  output.  The  deterministic  er¬ 
ror  inherent  in  five-channel  operation  and  most  cases 
of  four-channel  operation  of  the  multiplexer  is  due 
entirely  to  a  loss  or  inversion  of  certain  spectral 
components  of  the  multiplexed  signal  as  they  pass 
through  the  highly  non-linear  majority  gate.  The 
resultirg  signal  which  is  transmitted  to  the  demulti¬ 
plexer  either  contains  erroneous  information  or 
doesn't  contain  any  information  concerning  the  binary 
state  of  the  channel  associated  with  the  affected 
spectral  component. 
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Fig.  9  Binary  Input  and  Output  Spectra  for  Five  Input 
Majority  Gate  (Sequency  of  Active  Carriers: 

1,  2,  3,  4,  5) 


An  example  of  this  phenomenon  is  shown  in  Fig¬ 
ure  9.  Figures  9a  and  9b  show  the  majority  gate  in¬ 
put  and  output  spectra  representative  of  the  signal 
generated  by  logic  levels  ’’0",  "0",  "1",  "0",  "0" 
modulating  Walsh  carriers  wal  (1,  9  ),  wal  (2,  9  ), 
wal  (3,  9  ),  wal  (4,  | ),  wal  (5,  9  ),  respectively. 

The  spectra  for  logic  levels  "1",  "0",  "1",  "0",  "0"  ' 
modulating  the  same  carriers  are  shown  in  Figures 
9c  and  9d.  Note  that  the  output  spectra  for  the  two 
different  input  signals  are  identical,  and  the  wal  (I,#) 
component  which  was  present  at  the  input  has  dis¬ 
appeared  completely.  All  the  information  determin¬ 
ing  the  logic  level  that  was  multiplexed  from  channel 
number  one  for  this  particular  set  of  input  signals  has 
been  destroyed  by  the  non-linear  limiting  process, 
and  the  multiplexed  signal  has  become  ambiguous. 

Similar  input  and  output  spectra  are  shown  in 
Figure  10  for  input  logic  levels  ”00001"  and  "10001". 
Although  both  input  spectra  contain  energy  only  in 
the  sequency  range  wal  (1,  9 )  through  wal  (5,  9  ),  in 
this  case  the  majority  gate  processing  has  trans¬ 
ferred  energy  to  the  wal  (0,  9 ),  wal  (6,  $  )  and  wal 
(7,  9  )  sequences.  Again  for  these  selected  five  in¬ 
put  channels,  note  that  the  output  spectra  for  differ¬ 
ent  inputs  are  identical.  Yet  for  this  particular  set 
of  Inputs,  no  spectral  component  has  disappeared 
completely.  It  is,  of  course,  impossible  for  the  de¬ 
multiplexer  to  correctly  identify  the  logic  level 
transmitted  on  channel  number  one  for  this  particu¬ 
lar  set  of  inputs,  since  the  demultiplexed  channel 
number  one  logic  level  would  always  be  identified  as 


"zero"  regardless  of  the  binary  bit  actually  trans¬ 
mitted.  In  general,  for  each  choice  of  five  Walsh 
carriers,  eight  pairs  of  five-bit  input  word  sets 
were  found  to  be  ambiguous  (out  of  a  total  of  32  sets). 

For  the  case  of  four  active  multiplexer  chan¬ 
nels,  it  was  noted  that  only  certain  choices  of  Walsh 
carriers  will  produce  unambiguour  operation.  Fig¬ 
ure  11a  shows  the  input  spectral  components  for  the 
four-bit  input  word  "1100”.  Note  that  in  the  output 
spectrum  of  Figure  lib,  the  wal  (4,  t )  spectral 
component  has  been  inverted,  causing  the  multi¬ 
plexed  signal  to  be  incorrectly  identified  as  "1101" 
by  the  demultiplexer.  A  better  choice  of  Walsh  car¬ 
riers  for  four-channel  operation  is  shown  in  Figure 
12a,  where  four  input  logic  bits  "1001"  are  modu¬ 
lated  onto  Walsh  carriers  wal  (1,  t  ),  wal  (2,  9 ), 
wal  (5,  9  )  and  wal  (6,  9  ).  The  resulting  output 
spectrum  in  Figure  12b  shows  that  the  spectral  com¬ 
ponents  representing  the  active  Walsh  carriers  will 
be  correctly  demodulated  at  the  receiving  end  of  the 
system.  Indeed,  as  noted  in  Table  1,  all  16  possible 
four-bit  input  combinations  will  produce  valid  out¬ 
puts  for  this  particular  set  of  Walsh  carriers. 

Spectrum  Spreading 

As  a  result  of  the  spectrum  spreading  caused 
by  the  non-linear  majority  gate  processing,  the  mul¬ 
tiplexer  output  signal  includes  ail  Walsh  components 
from  wal  (0,  9  )  to  wal  (7,  9  ).  It  is  therefore  im- 
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Fig.  10  Binary  Input  and  Output  Spectra  for  Five  Input 
Majority  Gate  (Sequency  of  Active  Carriers; 

1,  2,  3,  4,  5) 
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Fig.  11  Input  and  Output  Spectra  for  Four-Input 

Majority  Gate  (Sequency  of  Active  Carriers: 
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Fig.  12  Input  and  Output  Spectra  for  Four  Input 
Majority  Gate  (Sequency  of  Active 
Carriers:  1,  2,  5,  6) 


perative  that  the  demultiplexer  "knows"  which  chan¬ 
nels  are  active  and  the  sequency  of  the  carriers  ser¬ 
vicing  each  channel.  This  requires  some  kind  of  link 
between  the  multiplexer  and  the  demultiplexer  to  con¬ 
vey  channel  activity  information.  One  of  the  multi¬ 
plexer  channels  could,  of  course,  be  reserved  for 
this  purpose. 


Conclusions 

Although  the  multiplexer  will  not  operate  pro¬ 
perly  when  only  five  channels  are  needed,  the  infor¬ 
mation  for  one  of  the  five  channels  can,  of  course,  be 
redundantly  multiplexed  onto  a  sixth  channel  for  this 
special  case.  When  four  channels  are  needed,  it  is 
essential  that  the  carriers  be  selected  properly. 
Furthermore,  regardless  of  the  number  of  active 
channels,  it  is  essential  that  the  demultiplexor  be 
informed,  in  some  manner,  as  to  which  Walsh  com¬ 
ponents  must  be  ignored.  Otherwise,  erroneous  in¬ 
formation  will  be  received  on  inactive  channels.  In 
general,  the  adaptive  majority  technique  is  an  attrac¬ 
tive  multiplexing  scheme  that  can  make  effective  use 
of  modern  digital  Integrated  circuits,  and  the  binary 
nature  of  Walsh  functions. 
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1.  Abstract 

The  continuous  supervising  of  the 
temperature  and  a  numter  of  possible 
other  parameters  of  a  power-cable  in¬ 
creases  its  economy  and  its  reliability 
considerably.  It  is -necessary  to  measure 
the  temperature  at  many  different  points 
along  the  cable  and  to  transmit  these 
values  to  a  central  monitoring  station. 
This  central  station  then  possesses  all 
the  information  necessary  to  load  the 
cable  best.  The  required  transmission 
of  information  from  many  measuring 
points  to  one  single  central  station  is 
done  by  Walsh- functions. 

2.  Introduction 

This  paper  deals  with  the  appli¬ 
cation  of  Walsh-functions  to  the  problem 
of  monitoring  a  power-cable.  The  problem 
as  defined  by  the  cable  producers,  was 
as  follows  [1]  : 

A  system  which  can  monitor  a  power 
cable  (specifically  an  oil  pressure  • 
cable)  along  a  length  of  approx. 

500  ft  should  be  designed.  Infor¬ 
mation  on  the  local  surface  tempe¬ 
rature  of  the  power-cable  and  a 
number  of  possible  other  parameters 
(such  as  oil  leakage)  is  to  be 
gathered  from  50  measuring  points 
distributed  along  the  cable  and 
transmitted  to  a  central  monitoring 
station  (Fig.  1.). 


Measuring  units 

w 


Power-cable 


Monitoring 

station 


Fig.  1:  Monitored  power  cable 


Such  a  system  would  be  cf  consider¬ 
able  commercial  importance  because  it 
would  permit  a  better  utilization  of 
power  cables.  A  cable  with  an  ur known 
temperature  profile  cannot  be  utilized 
to  its  proper  limit  because  of  the 
danger  of  thermal  breakcowr,.  Thus,  with 
the  monitoring  system,  a  considerable 
amcur.t  in  the  layout  of  an  underground 
power  distribution  network  could  be 
saved .  -  f 

This  problem,  although  inspired  by 
the  specific  application  of  pcwer  cables, 
can  be  considered  typical  of  many  moni¬ 
toring  situations  or  alarm  networks, 
such  as  might  be  required  for  pipelines, 
gas  conducts,  railway  lines,  etc. 

It  is  typical  of  such  an 
alarm  or  monitoring  system  that  a  great 
number  of  measuring  or  control  points 
have  to  be  connected  over  a  few  common 
wires.  The  use  of  some  form  of  m  u  1  t  i- 
p  1  e  x  i  n  g  becomes  imperative:  it 
seems  that  Walsh-functions  are  particu¬ 
larly  suited  for  this  power-caoie 
monitoring  situation,  because  the  trans¬ 
mission  rates  are  very  low  and  a  whole 
signal-cable  network  can  be  reserved 
entirely  for  the  monitoring  system. 

In  fact,  the  higher  harmonics  (in  the 
frequency  domain)  of  the  Walsh-functions 
do  not  become  into  conflict  with  the 
cut-off  frequency  of  the  signal-cable 
or  with  other  transmission  channels  as 
is  the  case  e.g.  if  sequency  multi¬ 
plexing  is  used  in  telephone  or  radio 
communications. 

The  practical  advantage  of  sequency 
multiplexing  for  this  particular 
application  becomes  evident  when  one 
looks  into  the  further  conditions  that 
are  imposed  on  implementation: 

-  The  measuring  elements  and  all  local 
electronic  circuitry  required  for 
multiplexing  has  to  be  miniaturized 
because  they  will  be  mounted  between 
the  lead  and  the  thermoplastic  sheath 
of  the  power  cable  (Fig.  2).  This  is 
necessary  for  monitoring  the  surface 
temperature  of  the  lead  and  to  detect 
any  oil  leakage.  Any  inductances  or 
large  capacitances  required  for  sine- 
wave  generation  thus  fall  out  of 


consideration,  and  preference  must  be 
given  to  simple  digital  circuitry  that 
can  be  packed  into  a  medium  scale 
Integrated  Circuit. 

The  reliability  of  the  measuring 
elements  and  multiplexers  should  be 
typically  larger  than  that  of  the 
power  cable  itself,  which  has  a  mean¬ 
time  to  failure  of  over  20  years.  This 
again  calls  for  Integrated  Circuitry. 
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Fig.  2:  Power  cable  cross-section 

-  A  large  amount  of  disturbances  (noise, 
spikes,  bursts)  are  expected  on  the 
transmission  wires  of  the  monitoring 
system:  these  could  be  due  to  short- 
circuits,  load  changes,  etc.  which 
are  present  on  the  high-voltage, 
high-power-cable.  This  condition  calls 
for  a  system  with  a  high  noise- 
immunity  ard  there  again,  a  Walsh- 
function  system  synchronized  by  strong 
synchronization  pulses  from  the 
central  monitoring  station  has  the 
added  advantage  that  correlation  de¬ 
tection  at  the  central  station  is 
possible. 

A  time  multiplexing  technique  could 
not  be  used  just  because  the  re¬ 
quired  high  noise  immunity  would  call 
for  long  transmission  times  for  the 
single  measuring  point  to  the  central 
monitoring  station.  This  would  lead 
to  unpermissible  high  cycle-times  for 
the  supervision  of  the  whole  cable. 

3.  Description  of  the  System 

We  have  basically  a  structure  with 
a  channel,  a  central  monitoring  station 
and  many  measuring  or  sending  cells 
(Fig.  3). 

To  every  measuring  cell  one 
particular  Walsh- function  is  assigned. 
This  Walsh- function  carries  address 
and  information  of  the  cell  at  the 
same  time. 


Measuring  cells  station 


Fig.  3:  Structure  of  the  System 

Each  unit  therefore  acts  as  a  Walsh- 
function  generator.  A  common  clock  is 
fed  from  the  monitoring  station  to  all 
the  peripheral  units:  it  is  used  to 
clock  a  binary  counter  in  every  unit, 
the  various  outputs  of  this  counter  are 
fed  to  a  logic  network  consisting  solely 
of  exclusive-or  gates.  The  few  variable 
connexions  of  this  logic  network  allow 
the  programming  of  the  desired  Walsh- 
function. 

This  scheme  permits  to  transmit  one 
binary  decision  from  every  measuring  cell 
to  the  monitoring  station  according  to  a 
simple  convention:  the  presence  of  a 
particular  Walsh-function  means  ”1", 
the  absence  means  "0". 

The  signals  of  all  the  sending  units 
are  fed  simultaneously  and  additively 
to  the  channel.  Thus  the  monitoring 
station  receives  the  sum  of  all  the 
individual  signals. 

To  transmit  more  than  one  binary 
decision  from  every  measuring  cell  to 
the  central  station,  a  signal- 
word  (e.g.  8  bits)  is  defined  (Fig.  4H 
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Fig.  4:  Signal-word 

The  signal-word  contains  the  Gray- 
coded  information  given  by  the  tempera¬ 
ture-sensitive  device  and  the  oil-probe. 
To  every  bit  of  this  signal -word, 
exactly  one  period  of  the  Walsh-function 
is  assigned.  If  the  corresponding  bit  is 


90 


"1",  the  period  is  transmitted,  other¬ 
wise  not. 


The  required  synchronization  is  pro¬ 
vided  by  a  synchronization  pulse  at  the 
beginning  of  eaoh  signal-word.  The 
synchronization  pulse  is  also  trans¬ 
mitted  from  the  central  station  to  all 
the  peripheral  units  and  assures  the 
parallelism  of  the  signals  of  all  the 
peripheral  units. 


In  our  case  the  channel  consists  of 
a  ‘j-vire-system.  Clock,  synchronization 
puloe3,  signals  and  supply  voltage  are 
carried  on  different  lines.  The  signals 
of  all  the  peripheral  units  are  super¬ 
posed  on  the  channel  by  current-addition. 


At  the  monitoring  station  the  signals 
arc  separated  by  synchronous  correlation 
(Pig.  5).  The  correlation  is  extended 
over  many  signal  words,  typically  32. 
This  is  possible  because  the  information 
changes  very  slowly:  the  cable  has  a 
thermal  constant  of  hours  and  the 
occurence  of  oil-alarm  is  unique:  if 
oil-alarm  occurs,  the  operation  of  the 
cablo  has  to  be  stopped.  As  an  addition¬ 
al  feature,  the  information  is  Gray- 
coded,  so  that  a  change  in  temperature 
by  one  quantizing  step  always  changes 
only  one  bit  of  the  signal  word.  The 
uncertainty  of  the  measurement  arising 
from  the  "long"  measuring  time  is  there¬ 
fore  at  most  one  quantizing  step  of  the 
temperature  value. 
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Pig.  5s  Central  monitoring  station 

This  scheme  allows  the  extraction  of 
the  data  of  any  arbitrary  sending  unit, 
or  -  with  the  aid  of  a  multiple  or 
multiplexed  correlator  -  groups  of 
sending  units.  The  output  of  the  cor¬ 
relator  is  equal  to  the  signal-word  sent 
by  the  measuring  cell.  It  can  be  trans¬ 
formed  back  into  an  analog  value  for 
display. 

The  time  required  to  extract  the 
information  of  all  50  units  if 
serial  oalling  is  used  is  about 
1  i  minutes  (the  olook-frequenoy  in  the 
system  being  2500  He).  With  parallel 


calling  (multiplexed  correlator)  this 
time  would  be  reduced  to  appro/.  2  sec. 


Ai-Ajdltlve.  Gaussian  Noise 

The  signal  arriving  at  the  monito¬ 
ring  station  (i.e.  the  Walsh-function 
we  are  interested  in)  has  a  certain 
3ignal  power  3,  and  the  unavoidable 
noise  has  a  power  N.  The  signal  to 
noise  power  ratio  S/N  at  the  input  of 
the  detection  process  is  therefore 
given. 


If  we  assume  for  the  moment  that  only 
one  Walsh-function  i3  present 
(s(t)=0)  and  that  we  have  ideally  low- 
pass  filtered  Gaussian  noise  (Pig. 5), 
the  signal  to  noise  power  ratio  S'/N' 
at  the  output  of  the  detection  process,- 
or  better,  the  signal  to  noise  ratio 
improvement 


*1  = 


SJ7N1 

S/N 


can  be  calculated. 


Fig.  6:  System  for  noise-calculations 

The  output  of  the  correlator  is 
called  R^,(0)  and  is  the  cross-corre- 

lation-fun&tion  of  the  incoming,  noise- 
corrupted  signal  and  the  locally  gene¬ 
rated  Walsh-function  W',  Since  the  cor¬ 
rupting  noise  is  a  random  variable,  the 
correlator  output  will  itself  be  a  ran¬ 
dom  variable.  Its  value  without  input- 
noise,  that  is  with  just  the  function 
a'W^t)  as  input,  is 

B  [^(Oa-  a 

The  additive  noise  gives  the  xandom 
variable  a  variance  *  ,  which  la  de¬ 
pendent  of  f  (low-pa8B-filter  cut-off 
frequency),  the  sampling  frequency  f 
and  the  correlation  duration.  8 


»1 


This  variance  turns  out  to  be 

([4],  p  282) 

s2=  Y]  ^  [a«f(i>-,2|:e<ta] 

k=-(n-i ' 
o 

€»  is  the  noise  power  at  the  output 
of  the  correlator. 

Therefore  the  signal  to  noise  power 
ratio  at  the  output  becomes: 

E2[R  w,(0)] 

S'  1  i 


The  signal  to  noise  ratio  then  can  be 
rewritten: 


In  the  same  figure  values  measured  on  a 
test  system  have  been  plotted. 


E2  [RfW,(0)] 


n-1 

YZ 

k=-(n-l) 


h_ -Jkl  „  fk>  .  /k  > 
2  nW!W'V  mNN' f  ■ 


From  this  equation  S'/N'  can  be  cal¬ 
culated.  The  calculation  is  rendered 
easier  if 

RW ' W ' ( f  > 

WiWi  *s 

is  assumed  as  the  constant  value 

Rn, tU,(0)=s  (worst-case) 

"iwi 

Furthermore,  Rj^-j  )  is  given  by  * 

■W*>  * 

1  "*"c 

being  the  double-sided  power 
density  of  the  white  Gaussian  noise. 

gt 

The  calculation  of  ^7  was  carried 

out,  under  the  above  worst-case  condi¬ 
tion,  for  a  cut-off  frequency  of  the  low- 
pass-filter  chosen-  at 


(t  =  shortest  pulse  duration  of  highest 
Walsh- function) . 

The  calculated  values  of  the  signal 
to  noise  improvement  7  are  given  in 
Fig.  7,  in  function  of  the  number  of 
samples  per  Walsh- function  period  where 
'Tf  is  obtained  from  S'/N'^the  equation: 

_  S  N1  a2  i  N1 
~  =  N  S'  =  S' 


20  V/ 


' — Correlation  over  1  period 
- Correlation  over  10  periods 

m  =  samples  per  Walsh  period 

- calculated  (without  low-pass  filter) 

calculated  (low-pass  filter) 
measured  (RC-section) 


Fig.  7:  Signal  to  noise  power  ratio 
improvement 

If  now  several  Walsh-functions  are 
present  (s(t)  ^  0)  neither  the  expected 
value  E  [(g(t)]  nor  the  variance  er  of 
the  correlator  output  are  affected,  if 
an  equal  number  of  samples  are  taken 
from  every  time  interval  tr.  (This 
follows  from  the  orthogonality  of  the 
Walsh-functions  and  the  linearity  of 
the  s.'S'.er  of  Fig.  6).  Thus,  the  curves 
shown  in  Fig.  7  are  valid  independent 
of  the  number  of  Walsh-functions  present 
on  the  channel. 

5.  Conclusions 

Walsh-functions  have  shown  to  be 
particularly  well  suited  for  a  situation 
where  a  large  number  of  binary  coded 
signals  with  a  low  transmission  rate 
have  to  be  multiplexed  in  a  single, 
noisy  channel.  A  Walsh  system  Becomes 
particularly  advantageous  where  mini¬ 
aturization  or  high  reliability  is  re¬ 
quired  because  it  can  easily  be  im¬ 
plemented  by  fully-digital  MSl's. 

With  a  synchronous  transmission  and 
correlation  detection  over  many  periods, 
the  main  problem  would  seem  to  be  the 
transmission  of  the  clock  and  synchro¬ 
nization  pulses  from  the  central  moni¬ 
toring  station  to  the  various  monito¬ 
ring  points.  In  the  situation  described 
in  this  paper,  it  may  be  assumed  that 
the  central  monitoring  station,  which  is 
at  the  same  time  the  power  source  of  the 
whole  system,  is  capable  of  seeding  out 
very  strong  pulses  that  are  hardly  dis¬ 
turbed.  In  another  situation,  howevr 
where  the  power  of  the  pulses  are  limi¬ 
ted,  this  additional  problem  would  have 


to  be  carefully  studied. 
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Abstract 

This  paper  describes  a  Sequency  Multiplexing 
System.  First  a  output  of  a  sequency  low  pass 
filter  (SLPF)  in  the  matrix  form  is  developed 
for  any  input  by  considering  the  first  m-terms 
of  Walsh  series  expansion  of  the  input.  The 
SLPF  is  assumed  to  be  composed  of  an  integrator, 
delay  elements,  a  sampler  and  a  zero-order  hold. 
The  number  of  delay  elements  is  dependent  upon 
m.  Using  a  block  Impulse  as  a  testing  input, 
the  sequency  multiplexing  system  is  constructed 
using  the  sequency  low  pass  filters.  The  output 
of  each  channel  of  the  system  is  expressed  in  a 
closed  mathematical  form.  The  use  of  the  pre 
and  post  amplifier  in  the  multiplexing  structure 
is  also  discussed.  Results  of  the  cross  talk 
between  the  channels  are  obtained  and  these  are 
given  in  a  table  form.  The  noise  in  the  channel 
is  also  considered. 

Introduction 

In  recent  years  Walsh  function  has  become 
quite  popular  in  communication  applications.  The 
advantages  of  Walsh  functions  are  primarily  due 
to  the  efficiency  of  implementation  and  signal 
manipulation.  Digital  networks  are  more  accept¬ 
able  to  the  practical  applications  since  the  in¬ 
vention  of  IC  circuits.  For  digital  networks, 
pulse  type  waveform  like  Walsh  functions  are 
more  suitable  than  sinusoidal  waveforms.  The 
use  of  Walsh  functions  in  multiplexing  systems 
have  been  discussed  in  previous  papers  {1,2,3]. 
In  this  paper  we  select  a  coranunication  model 
generally  used  in  a  multiplexing  system  for  de¬ 
tailed  investigation.  The  derivation  of  the 
equations  and  results  are  stated. 

Representation  of  Walsh  Functions  by  Matrices 

Walsh  functions  form  a  complete  set  of  ortho¬ 
gonal  functions  [4].  The  Walsh  function  K(ra,0) 
may  be  defined  by  the  difference  equation 

W(2n+p,6)  -  (-l)(ln/2J+p){W[n,2(e+  |)] 

+  (_l)(n+p)w[n,2(e-  I)]}  (1) 

where  p*0  or  1;  n-0,1,2, . . . ;  -l/2<9<l/2; 

[n/2]  defines  the  largest  integer  less  than  or 
equal  to  n/2.  Define  W(O,0)  as 

W(0  0)-  I1  £or  -1/2  £  9  <  1/2  (2) 

UlU,0)  \0  for  1/2  <  9  <  -1/2  W 

With  the  above  difference  equation  and  W(O,0), 
W(m,0),  d»1,2,...,  can  be  generated  in  sequence. 
For  example,  W(1,0)  can  be  obtained  by  setting 
p*l  and  n»0.  From  eq.  (1) 


W(1,0) 


{W[O,2(0+f)J  -  W(O,2(0-i  )]} 


The  function  W(O,20)  has  the  same  shape  as  W(O,0) 
except  it  is  squeezed  into  -1/4  <  0  <  1/4. 


W[O,2(0+  t)]  and  W[O,2(0-  7)]  translate  W(O,20) 
to  the  left  and  right  by  1/4.  After  W(l,6)  is 
found,  W(2,0)  can  be  generated  by  letting  n*l, 
p=0.  W(3,0) . . .etc. 

Fig.  (1)  shows  samples  of  Walsh  function.  T^e 
independent  variable  is  the  normalized  time  0*^. 
Tq  is  the  smallest  orthogonal  period  for  Walsh  0 
functions.  Since  Walsh  functions  are  pulse-type 
waveforms  with  amplitude  +1  or  -1,  it  is  more 
convenient  to  represent  the  subset  {w(O,0),..., 
W(o,0)}  within  one  orthogonal  interval  Tq  by  an 
(m+l)x(2r)  matrix,  where  r  can  be  calculated  by 
the  inequality 


(m+1)  <  2 


For  example: 

“■0  ..  f .  1 

WQ  “  [+] 


where  +  and  -  means  +1  and  -1  and  each  column 
represents  a  T0/2r  interval. 

Output  of  An  Ideal  Sequency  Low  Pass  Filter  (SLPF) 

The  Walsh  series  expansion  of  a  function  F(0), 
-1/2  <_  0  <  1/2,  can  be  expressed  as 
”  fl/2 

F(0)  -  £a(i)W(i,0)  5  a(i)  «  F(0)W(i,0)d0 

i“0  * -1/2  (4) 

The  Walsh  series  expansion  has  the  same  proper¬ 
ties  as  the  Fourier  series  expansion,  except 
when  F(0)  extends  over  the  range  of  -l/2^0<l/2. 
then  the  Walsh  se  ies  expansion  must  be  recalcu¬ 
lated  on  each  orthogonal  interval  such  as  1/2^0 
<3/2,  3/2<0<5/2,  etc. 

Let  F(0)  pass  through  a  sequency  filter,  the 
general  expression  for  the  output  can  be  written 
as  b 

Fq(5)  *  l  a(i)K(i)W[i,0-0(i) ]  (5) 

i»a 

The  type  (low  pass,  high  pass,  bandpass)  of  se¬ 
quency  filter  depends  on  the  values  of  a  and  b. 
K(i)  and  0(i)  determine  the  characters  of  the 
sequency  filter.  K(i)  is  called  the  attenuation 
factor  and  0(1)  is  called  time  delay. 

The  difference  betwpen  the  ideal  frequency 
and  sequency  filters  is  stated  as  follows.  In 
the  frequency  sense,  the  ideal  filter  can  be 
defined  by  having  a  flat  amplitude  and  linear 
phase  responses.  However,  we  defined  "the  se¬ 
quency  as  the  generalized  frequency  ,"  [5]  hence, 
the  "phase"  is  not  meaningful  ir  a  sequency  sense. 
Instead  the  ideal  sequency  filter  is  defined  as  a 
filter  with  a  flat  amplitude  response  and  a  con¬ 
stant  time  delay. 

The  output  of  an  ideal  sequency  low  pass  fil¬ 
ter  can  be  obtained  by  inserting  the  following 


values  in  Eq.  (5):  a»0,  b«m;  K(0)“K(l)-t. .  .»K(m)*l; 

0(O)“0(1)». .  ."0(m)“l  (6) 

That  means  the  sequency  low  pass  filter  passes 
the  first  m+1  terms  with  a  unity  attenuation  and 
time  delay.  Eq.  (5)  now  becomes 
Fo(3)«=a(O)W(O,0-l)+a(l)W(l,0-l)+. .  .+a(m)W(m,0-l) 

With  the  help  of  Eq.  (4),  the  form  of  Eq.(')^ 
can  be  rewritten  as 

n/ 2  f  1/2 

FQ(6)  ■  (  |_i/2F(0)W(O,0)d0  j_l/2F(0)W(l,9)d0 


-c 


J- 1/2 . .  J  —1/2 

1/2  'wco.b-lj 

F(0)W(m,0)d0]  W(l,0-1) 
-i/2  : 

ft(n,0-l) 


Each  element  in  the  row  matrix  may  be  considered 
as  tne  summation  of  2r  subintegrals.  In  each 
subinterval  W(ra,0)  is  a  constant  with  value  +1 
or  -1.  The  column  matrix  is  a  Walsh  matrix  with 
a  unit  tin.,  delay.  It  does  not  effect  the  re¬ 
sults  if  we  calculate  Eq.  (8)  In  current  time, 
then  dealy  the  whole  waveform  by  1. 

A  more  convenient  form  of  Eq.  (8)  is 


F(0)d@ 


[~2  2r 


F(0)d0 


F(0)d0]  W(1,0) 
-  W(m,0) 


~2+2r 

W(O,0)7Tfw(Ot0)“ 


W(l,8) 

W(m,0) 


For  convenience,  let  D»2r 
F„(0)  »  VW>  L  ,  ,  where 

U  ' LHi  1 

[20  f~2  0  (2 

V-lJ  1  F(0)d0...j  x  k  F(0)d0...j1  l  F(0)d0]  (10) 

~2  '2+D  2~5 

Eq.  (10)  shows  the  most  general  form  of  the  out¬ 
put  of  an  ideal  sequency  low  pass  filter.-  In  a 
real  situation  F(0)  is  divided  into  time  section 

-l/?<0<l/2,  l/2<0<3/2 .  The  outputs  of  the 

filter  are  calculated  on  each  time  base.  Such 
a  division  does  not  place  any  restriction  on 
the  signal  F(0).  However,  a  synchronization 
signal  is  required  from  which  the  beginning  and 
end  of  the  intervals  can  be  derived.  The  results 

of  the  first  few  w”*W  are  presented  as  follows 
v  .  m  m  . 


Example: 

For  explanation  purpose  the  input  waveform 
S^  is  picked  as  step,  ramp  and  parabolic  function 
in  each  interval.  The  output  waveforms  calculated 
from  Eq.  (10)  with  m»0,l,2,3  are  plotted  in  Fig.  2. 

Circuits  for  Ideal  Sequency  Low  Pass  Filter  (SLPF) 


The  basic  lay  out  of  a  SLPF  according  to  Eq. 
(10)  is  shown  in  Fig.  3. 

The  integrator  Integrates  the  input  function 
F(0)  with  time  interval  for  integration  which 
depends  upon  the  value  of  m.  In  the  circuit  the 
time  interval  for  Integration  is  determined  by 
the  operating  speed  of  the  switches  P.  and  P2- 
Practically  the  operating  speeds  of  P^  and  P^ 


are  set  equal  to  Tq/D  sec.  Switch  P2  samples 
the  value  of  the  integrator  at  the  end  of  each 
Tq/D  sec.  Pi  resets  the  initial  condition  of 
the  integrator,  then  the  integration  for  the 
next  Tq/D  sec.  starts.  The  switch  P3  sends  the 
sampled  values  to  each  delay  element.  The  period 
for  a  complete  full  circle  of  switch  P3  is  Tq 
sec.  It  is  obvious  that  an  accurate  time  refer¬ 
ence  for  switches  Pi,  P2,  and  P-j  is  required. 

At  the  end  of  each  Tq  sec  the  D*2r  samples  values 
from  P2  are  available  to  the  matrix  multiplier 
simultaneously.  The  output  of  the  matrix  multi¬ 
plier  is  a  row  matrix.  In  the  time  domain  this 
row  matrix  is  generated  in  columnwise  order.  The 
ZOH  holds  each  value  from  the  matrix  multiplier 
for  Tq/D  sec.  The  step  function  like  waveform 
at  the  output  of  the  ZOH  is  Fq(0) . 

The  special  case  for  SLPF  occurs  when  m»2r-l. 
In  this  case  W$  Wa  ■  2rI  always  holds.  This 
relation  not  only  simplifies  the  mathematical 
manipulation  but  also  simplifies  the  hardware 
associated  with  a  practical  sequency  low  pass 
filter.  The  modified  SLPF  for  this  case  is 
shown  in  Fig.  4.  It  is  apparent  that  this  is 
the  most  desirable  type  of  the  SLPF. 


Multiplex  System  by  Using  Walsh  Functions 


It  is  often  desirable  to  transmit  severrl 
messages  on  one  transmission  facility.  The  pro¬ 
cess  is  called  multiplexing.  Multiplexing  sys¬ 
tem  which  utilize  sinusoidal  carrier  or  subcar¬ 
riers  have  been  studied  extensively  in  communica¬ 
tion  theory.  The  use  of  Walsh  function  as 
carrier  or  subcarrier  in  multiplexing  systems 
has  recently  been  studied  by  Harmuth  [4]  and 
Hubner  [1-3].  In  this  section  we  derive  the 
output  for  each  channel.  The  related  topic  such 
as  pre  and  post  amplifier,  crosstalk,  etc.,  are 
discussed  in  the  following  sections. 

Fig.  5  shows  the  block  diagram  of  a  multiplex 
system  which  uses  Walsh  functions  as  subcarriers. 
The  set  of  Walsh  subcarriers  is  written  in 


matrix  form. 


(ID 


where  D  ■  2  .  The  input  signal  STi  is  an  impulse 
block  with  amplitude  1  and  duration  1.  This  sig¬ 
nal  is  the  basic  "building  block"  for  various 
order  of  Walsh  functions.  The  general  performance 
of  the  system  can  be  roughly  described  by  using 
a  signal  as  an  input.  The  signal  waveforms  at 
various  stages  of  the  system  can  be  easily  ob¬ 
tained  with  the  help  of  Eq.  (10)  and  Fig.  2. 

S™  passes  through  a  pre-amplifier  (PRA)  with  on 
adjustable  amplification  factor  Ag.  Therefore, 

Sgg  has  the  same  shape  as  Sfi  except  the  ampli¬ 
tude  times  Ai.  For  the  special  input  signal  STi, 
the  output  of  the  SLPF  has  the  same  waveform 
as  the  input.  This  fact  can  be  easily  observed 
from  Fig.  2.  Therefore,  S?g  las  exactly  the  same 
shape  as  Sjg  except  that  S2g  is  delayed  ty  Tq. 
After  multiplying  by  the  Walsh  matrix  in  Eq.  (11) 


S3  is  represented  in  matrix  form  as 
^lall  Vl2  "*  *lalD 

S3  ’  *iail  *iai2  *iaiD 

A  3  .  A  3  -  ,  ,  ,  A  3 
nl  n  n2  n  nD 


(12) 
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Since  each  column  dominates  a  To/D  interval,  the 
signal  S4  can  be  obtained  by  row  wise  summation 
of  S3 

n  n  n 

S,  ■  [  I  A  a  .  ?  A  a  -  ...  I  A  a  ] 

4  p-l  P  P1  ptl  P  P2  p-l  P  P° 


vj,  ?Vph{uI0'(14l^)  “  u[6-a+g>}}  (13) 

h-1  p=l  r  v 

The  actual  waveform  of  S^  is  shown  in  Fig.  6. 

Theoretically,  we  can  feed  the  signal  S^ 
directly  into  the  communication  channel.  Due  to 
the  step  function  like  waveform  as  shown  in  Fig. 
6,  the  wide  spread  of  the  frequency  spectrum  of 
the  signal  Sa  and  the  continually  Increasing 
demands  for  frequency  allocations  as  function 
of  n  provide  undesirable  properties  for  direct 
transmission.  An  ideal  frequency  low  pass  fil¬ 
ter  (LPF),  with  normalized  cut-off  frequency 
F  ,  has  been  placed  at  the  final  stage  of  the 
transmitter  for  the  purposes  of  reducing  the 
bandwidth  requirement  for  the  whole  multiplex 
system  and  reducing  the  interference  to  other 
communication  system. 

The  output  signal,  S3,  at  the  transmitter 
may  be  obtained  by  taking  the  Fourier  transform 
of  and  then  taking  the  inverse  transform 
with  a  frequency  limitation  Fc.  The  Fourier 
transform  of  an  individual  "step  element" 


Kv.M0-<1+!r>1 

p“l  r  r 


uieu+g))} 


is  represented  by  the  amplitude  response  A(f) 
and  phase  response  <t>(f). 

.  1  ■‘"J  ? . .  . .... . 


A<»  -  5 


nf  v 
~5  Pcl 


V  a  .  ; 
P  ph 


Taking  the  inverse  Fourier  transform  of  S4  with 
frequency  limitation  Fc  yields  for  the  output 
of  the  LPF 


D  n 

S_»  y  l  A  a 
5  h-1  p-l  p  ph 


.  rr  8 in  - 

i.  s 

*  _  n 


3l”l  -j2TTf(l+^) 

— — —  e  eJ  df 


..  S5aja  . 


r o  •  •  •  *>ca 

5  na  5  nD 


At  the  receiver  assume  that  the  SLPF  with  m-0, 
the  output  of  the  SLPP,  S7,  can  be  calculated  by 
applying  Eq.  (10) 

S-,-[  (Sca, , . ..S,a,  . . .S.a,_]d6 I 


“  ij.  {Si[2nFc(0-l-ti)j-Si[2„Fc(0-l-g))} 

P  «  ,  (15) 

where  S.(z)  -  — ^ — dt  [6]  (16) 

3  Jo  c 

Assuming  the  communication  channel  is  ideal  which 
means  the  channel  introduces  constant  attenuation 
and  time  delay  to  all  frequenies,  compensation 
for  constant  attenuation  can  be  achieved  by  either 
the  pre  or  the  post  amplifier.  Detection  of  the 
signal  in  the  presence  of  variable  time  delay 
may  be  accomplished  by  sending  synchronous  sig¬ 
nals  across  Fhe  channel.  This  sets  up  the  exact 
timing  between  the  transmitter  and  receiver. 

Hence,  it  is  reasonable  to  assume  that  the  sig¬ 
nal  passes  through  the  channel  without  any  dis¬ 
tortion. 

Multiplying  S5  by  the  Walsh  matrix  WS  gives 
p5all  •”  S5ala  ”•  S5alDi 


*[  iSc-a. -a  •  •  •  S-a.  •  •  •  S-a*i.]dG I 

Ji  5  -11  5  Ja  5  3°  e-e-i 

1+2 


-  S.2tiF  (e-l~)))d6  (18) 

1  c  D  e-e-i 

By  memorizing  the  time  delay  1 introduced  by  SLPF, 
we  omit  the  time  delay  sign  | 8-0-1.  Closed  form 
integration  is  obtained  by  appling  the  following 
formula 

jS^(x)dx  -  xSi(x)  +  cos  x+  c  (19) 

S_.  equals  S-,  times  B  .  Therefore,  the  outputs 
oi^the  entire^system  are  written  as 

v  ^  1  Jml  p!yPwHi(a'b)+H2(a'h)1 

H^a.h)  -  (-~)S12nFc(2^)+(2=iri)si27rFc(S^i) 

-  2(^)Sl2nFe(^) 

H2(a,h)  -  ^Ftcos2TiFc(-2^ti)+co827lFc(i:~) 

c 

-  2cos2nFc(2=!i))  (20) 

Fig.  7  shows  the  output  of  each  channel  (n»4). 
Sjj  is  calculated  by  setting  A.-l,  A.,-0  if  j^p, 

Bj“l  with  j-1,2,3,4.  In  Fig.  8  S!  is  obtained 
by  letting  Aj-Bj-1  with  j-1,2,3,4.  Figs.  9  and 
10  are  similar  to  Figs.  7  and  8  except  that  six 
channels  are  used. 

The  Use  of  Pre  and  Post  Amplifiers 

From  Fig.  7,  8,  9,  and  10  we  observed  that 
the  performance  of  each  channel  is  different. 

The  situation  becomes  worse  as  the  number  of 
signals  increases.  This  is  the  case  as  in  tele¬ 
phony  multiplex  systems  when  combining  twelve 
channels  as  base-group,  three  base-group  as  super¬ 
group,  etc.  The  final  performance  of  each  indi¬ 
vidual  channel  in  such  systems  will  be  far  dif¬ 
ferent.  This  circumstance  should  be  improved  if 
the  values  of  A_  in  the  pre-amplifier  of  the 
transmitter  and*Bj  in  the  post-amplifier  of  the 
receiver  can  be  adjusted.  In  order  to  get  the 
same  quality  in  each  channel,  we  solve  the  fol¬ 
lowing  simultaneous  linear  equations 

nC  “  Bj  LI  I  ajaApaph[Hl(a,h)+H2(a*h)] 

a-1  h-1  P-l  jml2 . „  (21) 

In  Table  1  we  show  the  possible  values  of  the 
pre-amplifiers  and  post-amplifiers  for  four  and 
six  signal  channels.  The  assumptions  for  calcu¬ 
lation  are:(l)  c-1.  For  the  case  cj*l  the  values 
of  Ap  and  Bj  should  change  proportionally.  This 
relation  can  be  obviously  seen  from  Eq.  (21). 

(2)  When  we  ajust  the  pre-amplifiers,  all  the 
post-amplifiers  have  value  1.  The  relation  being 
reversed  when  we  ajust  the  post-amplifiers. 

The  negative  values  for  the  pre  and  post  ampli¬ 
fiers  can  be  explained  as  at  the  cut-off  frequency 
F£  the  crosstalks  domiuate  the  outpus  (discussed 


in  next  section).  In  multiplex  systems  his  is 
undesirable.  Therefore,  we  choose  Fc  such  that 
all  the  values  of  the  pre  and  post  amplifiers 
are  positive. 

Discussion  of  Channel  Crosstalks 

The  crosstalks  between  channels  can  be  obtained 
directly  from  Eq.  (20).  Sj,  is  defined  as  the 
crosstalk  between  channels  3i  and  j.  Its  value 
means  that  with  an  input  at  channel  1  of  the 
transmitter,  we  calculate  the  output  at  channel 
j  of  the  receiver.  The  symmetrical  relation 
Sij-Sji  become  obvious  after  we  discuss  Eq.  (20) 
in  detail. 

From  Eq.  (20)  we  write  out  Sj,  directly 
D  D  J 

ITS.  -  l  l  a.  a  (H,(a,h)+H2(a,h))  (22) 

13  a-1  h-1  Ja  ln  1 

A  better  way  to  manipulate  this  summation  is 
to  write  out  the  following  matrix 


aj2ail 


°Jlai2 

aj2*i2 


ajDai2 


ajlaiD 

Sj2aiD 


ajDaiDj 


This  matrix  is  the  multiplication  of  two  rows 
in  the  Walsh  matrix  with  all  the  entries  +1  or 
-1.  The  summation  of  Eq.  (22)  equals  the  summa¬ 
tion  of  each  individual  element  inmatrix  times 
its  respected  H's  functions. 

Observe  from  Eq.  (20)  thar  H^a.h)  and  H2(a,h) 
are  symmetrical  with  respect  to  a  and  r.  In 
addition,  they  are  even  functions  of  (a-r).  The 
interchange  of  1  and  j  in  Eq.  (23)  does  not 
change  the  result  of  the  summation.  By  use  of 
the  aforementioned  properties,  it  can  be  shown 
that  Sji  -  S^,. 

By  defining  d  -  | a— h | 

H(d)-H1(a,h)+H2(a,h)  -  H1(|a-h|)+H2(|a-h|)  (24) 

then  the  summation  of  Eq.  (22)  becomes  a  summation 
of  each  element  in  the  following  matrix 

*)lailH(0*  ajlai2H^  '  ’  *  ajlaiDH(&"l5 

ij24\'.lH(D  aj?ai2H*0)  aj2aiDH^D_2^ 


ajlaiDHa^ 

aj2aiDH^D-2^ 


ajaaihH(a-h) 


fjDaiia<D‘1>  ajDai2H^2> 


ajDaiDH(0 


From  Eq.  (25)  we  get  the  "free  of  crosstalk" 
condition 


Ja,  a..  -  0  with  |a-h|“d  ;  d»0,l,2,.. . ,D-1 
Ja  ln  (26) 
Example;  Calculate  the  crosstalk  between  chan¬ 
nels  when  i-4,  j-4. 

From  the  Walsh  matrix  shown  in  the  first  sec¬ 
tion,  we  calculate  the  crosstalk  between  channels 
1  and  2  by  using  Eq.  (23).,, 
r  -rr  n  r.  i  «»0 


[--++] 


if  A £  i 


Using  the  criterion  of  Eq.  (26)  we  show  S.-0. 

By  the  same  token  the  crosstalk  between  chan¬ 
nels  1  and  3  can  be  calculated  by 

... 


ai2  a32  -  +  f-  +  +  .1  iSX'Vjsbvaf*H(1) 

a??  +[-  +  +  -i*Ck.\x^S» 

a14  a34  + 

L.  JL  J  LJ  L  C?0 

Therefore,  -  2H(1)  -  2H(3).  The  crosstalks 
between  other  channels  are  shown  in  Table  2. 

Included  in  the  Table  are  crosstalks  when 
i-8  and  j-8.  Fig.  11  shows  the  crosstalks 
between  channels  with  values  of  i  and  j  up  to  6. 

Noise  Consideration  ln  Multiplexing  System 

In  the  previous  sections  tne  multiplex  system 
without  medium  noise  was  considered.  When  the 
communication  channel  noise  is  introduced  some 
of  the  equations  require  changes.  A  review  of 
the  system  in  Fig.  5  shows  that  the  medium  noise 
is  added  to  S^.  The  equations  requiring  modi¬ 
fication  are 

S'";  l  7  A  a  ,{S,  [2itF  (6-1-^-)] 

5  *  h*l[p-l  p  ph  1  c  D 

-  Si[27iFc(0-l-g)]>+  n,7j  (15*) 

D 

-  S1t2rrFc(0-l-— )]}+  nh  d0  (18') 

-  ElBj-S^}  (20') 

where  E{x}  means  the  expected  value  of  x.  The 
sample  noise  waveform  in  the  orthogonal  interval 
is  presented  as  D 

n  “  l  V 

h-1  " 

Assuming  that  n  is  stationary  with  E{n)  »  N, 
Eqs.  (18)  through  (20')  yield 

,  B,  D  rl+j- 

snj  '  s«l  *  51  J  «■>« 


srj N  i'1 


In  the  above  equation  we  applied  the  basic 
property  of  Walsh  functions,  i.e.,  in  the  Walsh 
matrix  the  summation  of  each  row  equal  to  zero 
except  W(0,6).  We  saw  from  Eq.  (27)  that  the 
medium  noise  introduces  distortion  only  limited 
to  the  first  message  channel  which  use  W(0,6)  as 
the  carrier.  This  result  is  caused  by  the  com¬ 
bined  use  or  the  Walsh  function  and  SLPF.  This 
result  is  not  obtained  in  frequency  multiplexing 
systems,  because  the  LPF  ln  each  message  channel 
passes  a  portion  of  the  noise  whose  frequencies 
are  located  within  the  signal  frequency  band. 
This  is  one  of  the  advantages  in  using  sequency 
multiplexing  systems. 
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H.  HQbner 
Research  Institute 
of  the 

Telecommunication  Engineering  Centre 
of  the  Deutsche  Bundespost 
Darmstadt,  Federal  Republic  of  Germany 


Introduction 


In  communication  engineering  the 
methods  applied  for  multiplexing 
analogue  signals  using  Walsh  functions 
as  carriers  have  proved  useful  in  prin¬ 
ciple.  In  their  performance  they  are 
comparable  to  carrier  frequency  systems 
[l,  2].  They  also  allow  the  multiplexing 
of  digital  signals.  For  this  type  of 
signal,  however,  where  the  information 
is  available  in  a  quantized  form  more 
specific  methods  are  known.  All  of  them 
can  be  derived  from  a  common  system 
concept  as  shown  in  Fig.  i. 
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Tig.  1:  General  concept  of  transmission 

system 


According  to  it,  source-coded  digital- 
signals  of  p  channels  with  i  binary 
elements  each  reach,  within  a  time 
interval  TQ,  a  stage  which,  by  format 
conversion,  takes  the  signal  vector  SQ 
into  the  system  input  vector  Sj  with  n 
rows  and  j  columns.  This  conversion  is 
only  necessary  if  the  format  of  SQ  does 
not  correspond  with  that  of  Sj  for  which 


the  multiplex  arrangement  shows  optimum 
system  characteristics.  The.  multiplexing 
which  is  performed  by  combining  digital 
signals  with  the  carrier  set  T  can,  in 
general,  be  described  by  the  matrix 
equation 

(S2>  •  (Tl.tSj)  (1) 

In  order  to  adapt  the  resulting 
multiplex  signal  S2  to  the  characteris¬ 
tics  of  the  transmission  channel  it  can, 
in  addition,  be  subjected  to  a  limiting 
or  signal  protection  process  befere  the 
elements  of  the  transmit-signal  column 
vector  Sg  resulting  therefrom  are,  one 
after  the  other,  transmitted  to  the 
receiver  input.  From  the  signal  S'M  the 
receiver  recovers  the  channel  signals  S3 
by  an  operation  which  is  inverse  to  the 
multiplexing.  For  this  purpose  the 
matrix  equation 

(S3)  «  <T)T.  <s'm)  (2) 

is  to  be  performed,  it  requires  the 
transpose  of  the  carrier  matrix  to  be 
known.  Subsequently,  the  receiver  pro¬ 
duces  the  system  output  signal  S^  by 
weighting  of  S3  in  accordance  with 
system- inherent  conditions  in  the  stage 
for  signal  detection.  After  signal  for¬ 
mat  re-conversion  S^  becomes  S$  and 
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contains  the  digital  signals  of  the  p 
input  channels  to  be  transmitted.  With 
error-free  transmission  channel  there 
holds 

« 

S|^  •  •  (3) 

/ 

Irrespective  of  the  above  the  entire 
transmission  process  will  be  free  of 
errors  if 

S||  —  Sj  and  {43 

The  described  general  transmission 
concept  does  not  only  comprise  multi¬ 
plexing  by  means  of  sequency  division 
but,  as  a  special  case,  also  the  signal 
combination  and  transmission  by  pure 
time  division  and  thus  shows  the  close 
relation  between  these  different  multi¬ 
plex  principles.  The  assignment  of 
j-digit,  binary  code  signals  of  n 
channels  to  n  time  slots  in  the  multi¬ 
plex  signal,  which  is  common  practice 
in  the  case  of  PCM  systems,  and  their 
re-assignment  can  be  obtained  from 
equations  (1)  and  (2)  with  S2  =  SM  if 
(T)  is  the  identity  matrix.  Then  (T) 
represents  the  system  of  the  orthogonal 
block  pulses  which  serve  as  carriers  in 
the  case  of  multiplexing  with  pure  time 
division. 

Methods  of  multiplexing 
Multiplexing  by  carrier  modulation 

This  method  is  rigorously  based  on 
the  sequency  multiplex  principle  for 
analogue  signals  [3,  4].  It  allows 
binary  signals  to  be  transmitted  on 
Walsh  carriers,  which  can  be  represen¬ 
ted  in  the  time  interval  TQ  by  a  one¬ 
digit  column  vector  Sj  of  the  length  2* 
with  the  elements  ±  1.  The  multiplexing 
process  according  to  equation  (1)  is 
described  by  the  modulation  equation 

<S2>  «  (WHSj)  <S>^ 


where  (w)  is  the  orthogonal  system  of 
2k  Walsh  functions.  Multi-digit  column 
vectors  Sj  are  also  permissible.  In  this 
case,  however,  only  certain  Walsh  func¬ 
tions  may  be  used  as  carriers  [s] .  If 
S2  is  not  limited,  the  multiplex  signal 
is  obtained.  In  the  case  of  n  chan¬ 
nels  with  n  i  2*  its  amplitude  has 
(n  ♦  1)  possible  levels.  Here,  the 
frequency  of  occurrence  of  the  indivi¬ 
dual  amplitude  levels  shows  a  binomial 
distribution  and  is  symmetrical  to  xero. 
The  multiplex  signal  can  be  transmitted 
over  any  distance  on  channels  with  rege¬ 
nerative  repeaters  without  impairment 
of  its  information  content  by  cumulati¬ 
ve  noise.  From  SH  one  obtains  S3  accord¬ 
ing  to  equation  (2)  by  performing  the 
matrix  operation 

<S3>  *  2‘k(W)T.(S^>  (6) 

After  passing  through  the  signal  detec¬ 
tion  stage  which  normally  contains  zero- 
symmetrical  limiters,  there  hcldu 

<SH)  *  sign  [<S3)J  .  (7) 


Interference  signals  N  which,  during 
transmission,  are  superimposed  on  the 
multiplex  signal  and  are  quantized  by 
the  regenerative  repeaters  will  remain 
ineffective  as  long  as  the  interference 
D  -  which  is  calculated  from 


<S3>  *  2"k.(W)T.  [<Sm)*n]  = 

*  (S1)*2'k(W)T.N  -  (Sj)  ♦  D 


(8) 


according  to  equation  (6)  -  is  suppress¬ 
ed  during  signal  detection  in  accord¬ 
ance  with  equation  (7). 

With  n  *  2  channels  there  are 
(n  ♦  I3n  different  signal  patterns  in 
the  multiplex  signal,  only  2n  of  which 
occur  in  their  representation  by  the 
input  signal  vector  Sj.  Because  of  its 
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multi-level  amplitude,  S2  contain*  a 
high  redundancy  component.  It -is  not 
required  for  signal  recovery  in  the  re*' 
ceiver  and  can  be  partly  removed  by  li¬ 
miters  in  the  signal  limiting  stage. 
Here,  the  number  of  amplitude  levels 
required  for  an  errcr-free  transmission 
depends  on  the  number  of  operated  chan¬ 
nels  and  the  multiplex  signal-to-noise 
ratio.  For  a  4-  and  8-channel  system 
with  the  limiting  degree  a  as  parameter 
Fig.  2  shows  the  immunity  of  the  multi¬ 
plex  equipment  against  external  noise  as 
a  function  of  the  number  n  of  active 
channels.  Here,  St  is  the  minimum  thres¬ 
hold  distance  occurring  in  the  case  of 
all  possible  signal  vectors  Sj  to  S^. 


Multiplexing 


binary  addition 


>23*  5  S  7  » 


t-chamd-ymfm  8*dionof^*^'fwn 

Fig.  2:  System  immunity 

For  an  error-free  transmission  the 
multiplexing  by  carrier  modulation  in 
general  requires  a  higher  bit  rate  than 
a  pure  time  division  multiplex  method 
and  a  more  complex  regenerative  re¬ 
peater  because  the  multiplex  signal 
has  more  than  two  levels. 


The  disadvantage  of  a  multi-level  multi¬ 
plex  signal  is  avoided  by  a  computer- 
aided  multiplex  method  which  is  based 
on  the  multiplexing  by  carrier  modula¬ 
tion  but  performs  the  calculating  ope¬ 
rations  required  for  multiplexing  and- 
signal  recovery  in  the  binary  number 
system  [6,  7].  It  is  not  necessarily 
confined  to  Walsh  functions  as  carriers. 
Any  orthogonal  carrier  sets  (T)  are 
permissible  if  there  is  the  transpose 
of  (T).  Because  of  its  two-valuedness , 
signal  S2  which  is  produced  by  multi¬ 
plexing  is  well  suited  for  transmission. 

If  j-digit  binary  signals  per  chan¬ 
nel  form  the  signal  input  vector  Sj, 
the  multiplexing  process  according  to 
equation  (5)  with  2*  channels  results 
in  (k  ♦  j  > • 2^  binary  digits  for  Sj.  The 
multiplex  signal  has  a  high  redundancy 
component  because  for  a  redundancy- free 
transmission  with  multiplexing  by  time 
division  only  j»2k  digits  are  required. 
The  inevitable  redundancy  R  rises 
exponentially  with  increasing  number  of 
channels 

R  *  k-2k  (9) 

The  ratio  of  the  number  of  binary  digits 
produced  by  the  binary  addition  to  the 
number  of  digics  required  for  the  time 
division  multiplex  techniques  is  des¬ 
cribed  by 


vk  =  i* 


It  moves  towards  unity  to  such  an 
extant  as  the  number  of  channels  decreas¬ 
es  with  resprct  to  the  length  of  the 
binary  signals  to  be  transmitted. 
Equations  (9)  and  (10)  illustrate  the 
high  redundancy  content  which  results 
in  an  uneconomical  system  design. 


vira- 


When  considering  the  signal  characte¬ 
ristics  of  S2  it  becomes  evident  that 
by  utilization  of  signal  symmetries  the 
inevitable  redundancy  can  only  unessen¬ 
tially  be  reduced  to 

R'  =  (k  -  l).2k  (11) 

If 

The  division  by  2  to  be  carried  out 
according  to  equation  (6)  does  not  lead 
to  any  reduction  in  digits  in  the  multi¬ 
plex  signal. 

Investigations  into  the  system  be¬ 
haviour  in  the  case  of  interference  in 
the  multiplex  signal  have  revealed  that 
its  effect  depends  on  the  error  location 
in  and  influences  all  channels.  Here, 
it  becomes  apparent  that  the  possible 
signal  patterns  of  SM  have  unequal 
Hamming  distances  between  each  other. 

Very  often  they  are  only  separated  from 
each  other  by  the  minimum  distance  1. 

The  redundancy  in  the  multiplex  signal 
thus  allows  error  detection  and  correc¬ 
tion  only  in  some  specific  cases. 

There  is  no  basic  change  in  the 
system  behaviour  if  not  all  of  2  possi¬ 
ble  channels  are  active.  The  Multiplex 

U 

signal  then  has  (j  ♦  x)*2  binary  digits, 
where  x  is  a  discontinuous  quantity 
which  depends  on  the  activity  factor.  It 
assumes  the  value  ).  even  with  mean 
system  loading.  On  the  other  hand,  there 
is  a  decrease  in  the  number  of  signal 
patterns  of  S„  having  the  Hamming 
distance  1,  In  general,  there  are  no  new 
symmetries  in  the  multiplex  signal, 
which  can  be  utilised  for  bit  rate  re¬ 
duction. 

Only  in  the  case  of  8-channel  systems 
with  activity  factors  *  25  %  symmetry 
characteristics  develop  in  the  multiplex 
signal,  the  utilization,  of  which  leads 
to  minimum  bit  rates.  With  two  active 
channels  they  are,  however,  still  1  bit 
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per  channel  above  the  bit  rate  required 
for  the  method  applying  pure  time  divi¬ 
sion  multiplexing. 

It  becomes  obvious  that  the  multi¬ 
plexing  with  binary  addition  produces 
a  two- valued  multiplex  signal  with  re¬ 
dundancy  which  can  neither  be  eliminated 
nor  be  sufficiently  used  for  error  de¬ 
tection  and  correction.  The  multiplex 
method  described  above  results  in  a 
procedure  with  non-optimum  coding. 


This  principle  is  a  modification  of  the 
multiplexing  by  carrier  modulation.  It 
differs  from  the  latter  in  specially 
chosen  carrier  sets  and  enables  digital 
signals  to  be  transmitted  free  from 
redundancy  on  a  limited  number  of 
channels  or  under  certain  conditions 
the  utilization  of  system-inherent 
redundancy  for  error  detection  and 
correction  purposes  [8,  9]. 

The  input  signals  of  n  channels 
which  are  combined  to  form  one-digit 
column  vectors  Sj  change  according  to 
equation  (1)  the  amplitude  of  the  row 
vectors  of  (T)  serving  as  carriers. 
After  summation  one  obtains  a  signal 
S2  whose  amplitude  has  (n  +  1)  levels. 
By  a  clipping  symmetrical  to  zero,  it 
is  transferred  into  the  two-valued 
redundancy-free  signal  SM 

<SM)  »  sign[(S2)]  (12) 

and  transmitted  to  the  reouiver  input. 
Demodulation  is  carried  out  in  the 
manner  normally  used  in  the  sequency 
technique,  i.e.  by  correlation  with 
subsequent  threshold  weighting  of  the 
detected  signal.  With  equation  (2)  one 
obtains 

CS^)  *  sign[(S3)]  (13) 
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The  signal  transmission  is  free  from 
errors  if  number  of  channels  and 
carrier  set  meet  certain  conditions! 
i.e.  the  number  of  channels  and  the 
elements  of  the  row  vector  of  the 
carrier  matrix  must  be  odd.  Then,  the 
carriers  form  only  a  quasi- orthogonal 
system  since  the  cross- correlation  be¬ 
tween  the  individual  functions  no  longer 
is  zero.  The  information  loss  increas¬ 
ing  with  growing  number  of  channels 
due  to  amplitude  limitation  in  the 
multiplex  signal  and  the  errors  due 
to  disturbed  correlation  confine  the 
unambiguous  signal  transmission  to  a 
maximum  of  seven  channels.  Here,  the 
carriers  used  either  can  be  derived 
from  reduced  Hadamard  matrices,  which 
are  obtained  by  removing  one  of  the  rows 
and  one  of  the  columns,  or  they  may  con¬ 
sist  of  cyclically  shifted  3-  and 
7-digit  binary  pseudo-random  sequences. 
Other  carriei  sets  give  rise  to  system 
errors. 

The  effect  of  bit  errors  in  the 
multiplex  signal  occurring  during 
transmission  varies  with  the  degree  of 
system  loading.  It  has  become  apparent 
that  the  error  distribution  and  correc¬ 
tion  properties  are  independent  of  the 
carrier  system  used.  Investigations  into 
the  behaviour  of  a  fully  loaded  7-chan¬ 
nel  system  show  that  the  error  effect 
depends  on  the  values  of  the  disturbed 
amplitude  level  in  the  multiplex  signal 
prior  to  clipping.  If  one  element  in 
SH  is  disturbed,  a  maximum  of  <«  chan¬ 
nels  are  falsified.  Fig.  3  illustrates 
the  probability  p  (i)  with  which,  in 
the  case  of  one  error  in  the  multiplex 
signal,  i  channels  become  faulty  when 
all  of  the  128  possible  signal  vectors 
S1  are  equally  distributed. 

Contrary  to  the  r  1-  plex  signal 
in  a  fully  loaded  system,  SM  contains 
redundancy  components  in  a  partly  load¬ 
ed  .system.  Under  certain  conditions 


Fig.  3:  System  error  behaviour 

this  redundancy  has  an  automatic  error 
correction  effect.  However,  error  correc¬ 
tion  only  takes  place  in  systems  where 
4  or  6  channels  are  disconnected.  Other¬ 
wise,  errors  occur  in  spite  of  redundancy. 
A  7-channel  system  with  majority  decision 
corrects  up  to  3  errors  in  the  multiplex 
signal  if  one  channel  only  is  active. 

With  3  channels  in  operation,  one  error 
remains  ineffective.  If  signals  from  more 
than  7  channels  are  to  be  transmitted  by 
multiplexing  with  majority  decision, 
groups  derived  from  3-  and  7-charnel 
systems  must  be  used  in  hierarchical 
structure.  Here,  it  is  advisable  to 
fully  load  the  systems  of  the  lower 
groups  and  to  assign  free  channels  to 
the  uppermost  group  if  there  is  the  risk 
of  a  disturbed  transmission.  This 
avoids  the  possibility  of  magnified 
error  propagation  in  the  case  of  fully 
loaded  and  cascaded  systems. 

The  multiplexing  by  majority  decision 
turns  out  to  be  a  method  for  the  combi¬ 
nation  of  a  limited,  odd  number  of 
channels  which  enables  the  signals  of  a 
fully  loaded  system  to  be  transmitted 
at  the  same  bit  rate  as  in  the  case  of 
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tiae  division  multiplexing.  Its  error 
behaviour  is  poor  if  the  system  is  fully 
loaded.  Only  with  one  and  three  active 
channels  it  makes  optimum  use  of  the  re¬ 
dundancy  existing  in  the  multiplex  sig¬ 
nal  without  requiring  additional  circuit¬ 
ry  for  error  correction. 


In  the  receiver  the  multiplex  signal 
can  no  longer  be  separated  by  means  of 
correlation  methods.  The  multiplexing 
process  represents  an  unambiguous  and 
thus  reversible  mapping.  Recovery  of 
the  signals  is,  therefore,  effected  by 
operations  being  inverse  to  0  and  ©  . 


Multiplexing  by  dyadic  combination 

The  calculating  operations,  addition  and 
subtraction,  which  are  required  for 
multiplexing  and  which,  in  the  case  of 
the  two  previously  described  multiplex 
methods,  were  performed  in  the  decimal 
and  binary  number  systems  are  here  re¬ 
placed  by  dyadic  combinations  [lO,  ll]. 
In  this  method  the  modulo-2-addition 
corresponds  to  the  addition  and  the 
"Searle"  operation  to  the  subtraction. 
The  latter  is  so  defined  that  for  two 
j-digit  binary  numbers  A  and  B  each 
the  expressions 

X  *  A  ©  B  ;  B  s  A  ©  B  (14) 

allow  unequivocal  conclusions  to  be 

drawn  with  respect  to  A  and  B.  This 

multiplex  method  permits  the  combination 
k 

of  2  channels.  The  multiplexing  process 
produces  a  two-valued  multiplex  signal 
without  additional  digits. 

If  n^  is  the  j-digit  input  signal  at 
channel  i,  the  multiplexing  process 
according  to  equation  (1)  for  4  channels 
yields 


V 


(nj  ©  n~)  ©  (n3  ©  n4) 
<nj  ©  n?>  ©  (n3  ©  n4> 
(n3  ©  n2)  ©  (n3  ©  n4) 
(nj  ©  n?>  ©  <n3  ©  n4) 


(15) 


The  •  ctor  3j  can  be  calculated  step  by 
step  so  that  each  of  the  expressions 
used  need  be  determined  only  once. 


The  dyadic  combination  may  refer  to 
either  one  or  several  binary  digits. 
With  the  one-digit  combination,  2  j- 
digit  binary  numbers  each  are  combined 
digit  by  digit. 

A  —  A  0  B  A  -  (a. ,  a^^, . . .a^) 

B  =  A  ©  B  B  =  (bj,  , . .  .bj)  ** 

©  b,  w  0  b,  (16) 


'»,*»,© b. 

0  1 

bl  •  a1  ©  bl 

0  1 

! 

0  1 

1  0 

»  0 

1  1 

1  0 

1  0 

This  is  a  possibility  of  defining  the 
non-ccmmutative  "Searle”  operation  in 
such  a  manner  that  the  .;mery  charac- 
ters-A  and  B  allow  conclusions  to  be 
drawn  with  respect  to  A  and  B.  The 
separation  is  effected  by  the  inverse 
operations: 


inv»r»t  © 

V 


*1 

0 

1 

~  0 

1 

0 

*1  1 

0 

1 

imrtt© 


bf 

0 

1 

T  0 

1 

0 

*1  1 

1 

0 

(17) 


Even-number  input  signals  can  be  com¬ 
bined  with  the  two-digit  dyadic  combi¬ 
nation  which  is  performed  in  pairs: 


© 


© 


t?r  *2i.i 

V  b21-1 

00  01  11  10 

b2l*  b2l-1 

b2l*  b2l.1 

00  01  11  10 

no 

00  01  11  10 

00 

00  10  01  11 

,  01 

01  00  10  11 

,  ,  01 

11  01  10  00 

2t*  21-1  11 

11  10  00  01 

*21*  21.1  11 

10  00  11  01 

10 

10  11  01  00 

10 

01  11  00  10 
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With  the  aid  of  the  ona-digit  mul¬ 
tiplex  law  coluan  vectors  of  the  input 
signal  aatrix  Sj  are  aapped  to  coluan 
vectors  of  the  aultiplex  aatrix  S?.  On 
the  other  hand,  the  two-digit  method 
allocates  coluan  pairs  to  each  other. 
This  is  a  coding  process.  The  inverse 
operations  required  for  decoding  two- 
digit  combined  signals  are  defined  as 
well. 

If  during  transmission  errors  arise 
in  the  multiplex  signal  due  to  inter¬ 
ference  signals,  the  analysis  of  the 
system  behaviour  shows  that  the  inter¬ 
ference  effect  ic  largely  dependent  on 
the  error  location  in  S^.  The  unambiguous 
mapping  of  Sj  to  indicates  that  there 
is  a  regularity. 

For  a  fully  loaded  4-channel  system 
with  multiplexing  by  one-digit  dyadic 
combination,  the  upper  diagram  of 
Fig.  4  shows  the  number  Fe  of  disturbed 
output  channels  with  one  falsified  mul¬ 
tiplex  bit  as  a  function  of  error  loca¬ 
tion.  The  lower  diagram  represents  the 
aaximua  number  F__.„  of  disturbed 

€naX 

channels  if  at  the  same  time  e  errors 

i 

occur  in  S^.  The  system  behaviour  of 
a  fully  loaded  8-channel  system  is 
shown  in  Fig.  5  in  the  same  manner. 

The  channels  disconnected  by  being 
loaded  with  a  constant  zero  signal 
produce  redundancy  in  the  aultiplex 
signal  which  leads  to  an  increased 
Hamming  distance  between  the  remaining 
multiplex  signal  patterns.  It  depends 
essentially  on  the  position  of  the 
inactive  channels  in  the  system  and,  in 
general,  is  smaller  than  in  the  case  of 
optimum  coding.  Only  one  special  multi¬ 
plexing  mode  in  each  case  allows  the 
aaximua  possible  redundancy  utiliza¬ 
tion.  1st  analysis  shows  that  in  the 
4-channel  system  optimum  conditions 
exist  with  disconnected  channels  1  tc  3 
and  that  in  the  8-channel  system  the 


Fig.  4:  Error  behaviour  of  the  4-ehannel 
system  with  one-digit  dyadic 
combination 


Fig.  5:  Error  behaviour  of  the  8-channel 
system  with  one-digit  dyadic 
combination 


Hanning  distance  is  8  if  only  the  first 
channel  is  active.  Here,  three  errors  can 
be  corrected  and  quadruple  disturbances 
can  be  detected  as  it  is  the  case  with 
optimum  codes. 

For  a  fully  loaded  4-channel  system 
where  the  multiplexing  process  is  perfor¬ 
med  by  a  2-digit  dyadic  combination  of 
the  input  signals,  the  upper  diagram 
plotted  in  Fig.  6  shows  the  number  Fe 
of  disturbed  receiving  channels  which 
occur  if  the  sign  of  one  digit  in  the 
multiplex  signal  is  inversed.  The  ab¬ 
scissa  is  the  error  location  Su  .  .. 

The  lower  diagram  shows  the  maximum  num¬ 
ber  F„_„  of  disturbed  output  channels 
emax 

with  e  simultaneously  occurring  errors 
in  the  multiplex  signal.  Fig.  7  illus¬ 
trates  the  corresponding  behaviour  of  a 
fully  loaded  8-channel  system. 
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Fig.  7:  Error  behaviour  of  the  8-channel 
system  with  two-digit  dyadic 
combination 
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Fig.  6:  Error  behaviour  of  the  4-channel 
system  with  two-digit  dyadic 
combination 


The  investigation  of  the  usability  of 
the  redundancy  that  inactive  channels 
produce  in  multiplex  signals  formed  by 
2-digit  dyadic  combination  of  the  input 
signals  yields  optimum  conditions  for  the 
4-channel  system  only  with  an  active 
fourth  u-.annel . The  other  operating  con¬ 
ditions  of  the  4-channel  system  as  well 
as  all  loading  possibilities  of  the 
8-channel  system  do  not  meet  the  stand¬ 
ard  set  by  the  optimum  codes. 

The  multiplexing  by  dyadic  combination 
proves  to  be  a  method  which  enables  d5.- 
gital  signals  to  be  combined  to  a  two¬ 
valued  multiplex  signal.  The  multiplexing 
and  signal  separation  processes  can  be 
described  by  matrix  operations.  These 
are  based  on  formation  laws  which  are 
equivalent  to  the  coding  instructions 
for  linear  codes.  The  error  behaviour  of 
fully  loaded  systems  is  inferior  in  com¬ 
parison  to  the  transmission  with  pure 
time  division  multiplexing.  The  same 
applies  also  to  transmission  systems 
having  inactive  channels.  A  few  systems 


with  special  loading  conditions  are  the 
only  exception.  They  enable  signal  pro¬ 
tection  which  is  only  possible  in  the 
case  of  optimum  coding. 

Comparison  of  systems 

The  described  methods  allow  the  trans¬ 
mission  of  digital  signals  over  a 
common  channel  by  means  of  multiplexing. 
They  differ  in  the  required  bit  rare  of 
the  multiplex  signal  as  well  as  in 
their  error  behaviour  in  the  case  of 
transmission  disturbances  and  do  not 
utilize  the  different  redundancy  compo¬ 
nents  inherent  in  the  respective  system 
to  the  same  degree  for  signal  protec¬ 
tion  when  the  system  is  fully  or  only 
partly  loaded. 

When  using  the  characteristics  of  a 
multiplex  equipment  with  pure  time 
division  as  a  criterion  for  the  suita¬ 
bility  of  digital  communication  systems, 
the  multiplexing  by  carrier  modulation 
does  not  prove  equivalent  since  it 
produces  a  multi-level  multiplex  signal 
with  an  increased  bit  rate  the  error-free 
transmission  of  which  requires  expensi¬ 
ve  regenerative  repeaters.  This  rating 
will  certainly  not  be  changed  by  the 
fact  that  with  identical  signal-to- 
noise  ratios  the  two  multiplex  methods 
are  equally  sensitive  to  white  noise, 
wherean  the  sequency  multiplex  system 
is  more  insensitve  to  short  pulses  as 
source  of  interference  [s] .  Moreover, 
because  of  the  higher  bit  rate  to  be 
transmitted  and  the  poor  utilization  of 
redundancy,  the  multiplexing  by  binary 
addition  in  general  proves  inferior  to 
the  time  division  multiplex  principle. 

The  multiplexing  by  majority  decision, 
too,  is  less  advantageous  due  to  low 
flexibility  and  poor  error  behaviour 
in  the  case  of  a  fully  loaded  system. 
However,  it  compensates  for  its  disadvan¬ 
tages  occurring  in  connection  with 


certain  minor  activity  factors  by  auto¬ 
matic  signal  protection  which  requires 
additional  circuitry  in  the  case  cf  time 
division  multiplex  techniques.  The  mul¬ 
tiplexing  by  dyadic  combination  which, 
owing  to  the  dyadic  operations  used  is 
to  be  included  in  the  sequency  technique, 
is,  in  general,  also  disadvantageous 
because  of  its  poor  error  behaviour. 

Here,  the  characteristics  of  a  time  divi¬ 
sion  multiplex  system  are  obtained  only 
under  a  few,  very  special  operating  con¬ 
ditions. 

All  in  all  it  becomes  apparent  that 
the  multiplexing  of  digital  signals  in 
the  sequency  technique  with  characteris¬ 
tics  of  normal  time  division  multiplex 
systems  can  be  performed  only  under 
very  specific  and  very  limiting  con¬ 
ditions. 
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Introduction 


The  transmission  efficiency  of  multiplex¬ 
ed  digital  voice  channels  can  be  significantly 
improved  if  the  distribution  of  the  total  channel 
capacity  among  the  various  baseband  channels 
"is  not  fixed  but  is  varied  on  the  basis  of  the  in¬ 
stantaneous  requirements.  The  reason  for  this 
is  that  the  amplitude  of  a  single  voice  signal 
varies  from  relatively  short  periods  of  high 
levels  to  long  periods  of  very  low  levels.  While 
signal  companding  (attenuating  the  higher  signal 
levels  at  the  encoder  input  and  the  lower  levels 
at  the  decoder  output  -  compressing  and  expand¬ 


posite.  From  the  central  limit  theorem,  the 
amplitude  distribution  of  the  sum  of  a  number 
of  voice  signals  approaches  a  normal  distribu¬ 
tion  as  the  number  becomes  large,  so  even 
though  each  channel  might  ’•equire  a  peak-to- 
mean  coding  range  of  28  dB  the  peak-to-mean 
coding  range  of  the  overall  encoder  may  only 
have  to  be  somewhat  greater  than  the  8  dB 
needed  for  a  normal  distribution.  This  can 
only  be  obtained  if  the  proportioning  of  the 
overall  coding  capacity  among  the  baseband 
channels  is  not  predetermined  but  rather  is 


ing)  can  improve  the  situation  there  still  re¬ 
main  the  conversational  pauses.  Brady  l^has 
obtained  data  which  indicates  an  activity  factor 
of  only  40%  for  one-way  in  a  two-way  conversa¬ 
tion.  Thus  a  coding  scheme  based  on  an  equally 
spaced  sample  values  taken  on  a  single  voice 
signal  will  produce  the  zero-level  code  word 
with  a  probability  of  0.  6.  This  in  itself  leads  to 
a  fairly  poor  transmission  efficiency  even  when 
only  a  small  number  of  distinct  code  words  are 
used. 

An  indication  of  the  extent  of  this  ineffi¬ 
ciency  can  be  obtained  from  the  data  reported 
in  either  Brady  (1)  and  (2)  or  in  Sunde  If 
we  establish  the  criterion  that  99%  of  the  voice 
signals  are  to  be  below  the  maximum  coding 
level  at  least  99%  of  the  time,  Brady's  data  in¬ 
dicates  that  the  mean  power  level  of  a  channel 
must  be,  on  the  average,  about  26  dB  below  the 
maximum  coding  power  level  while  Sunde 's  data 
shows  this  to  be  about  28  dB.  Of  this,  4  dB  re¬ 
presents  the  60%  inactivity.  In  comparison,  the 
same  criterion  could  be  satisfied  with  an  average 
mean  power  level  only  8  dB  below  the  maximum 
coding  power  level  if  the  signal  amplitude  were 
normally  distributed.  This  18  or  20  dB  is  a 
significant  difference.  If,  for  example,  a  20 dB 
improvement  in  signal-to-noise  ratio  were  ob¬ 
tainable  in  a  linear  PCM  encoder,  the  number 
of  bits  per  sample  needed  could  be  reduced  from 
seven  to  four  or  from  six  to  three. 

In  simultaneously  encoding  a  number  of 
voice  channels,  these  inefficiencies  can  be  mea¬ 
surably  reduced  by  encoding  the  several  base¬ 
band  signals  collectively.  In  doing  this,  advan¬ 
tage  can  be  taken  of  the  statistics  of  the  corn- 


allowed  to  vary  in  accordance  with  the  instan¬ 
taneous  demands.  In  this  way,  the  capacity 
released  by  one  baseband  channel  during  periods 
of  inactivity  can  be  utilized  for  the  transmission 
of  information  pertaining  to  the  other  channels. 

Besides  having  a  code  that  permits  the 
total  channel  capacity  to  be  proportioned  among 
the  individual  baseband  channels  as  needed,  the 
encoder/multiplexer  will  also  require  some 
metns  of  determining  what  this  proportioning 
should  be.  This  should,  of  course,  be  what¬ 
ever  is  required  at  the  time  to  achieve  the  best 
performance  from  the  equipment,  which  implies 
that  the  encoder /multiplexer  must  be  capable 
of  judging  how  badly  things  are  going  so  that  it 
can  juggle  the  channel  capacities  around  to  try 
to  make  things  better.  One  version  of  this 
technique  is  used  in  multi-channel  Delta  modu¬ 
lation. 

The  Multi-Channel  Delta  Modulator 

A  block  diagram  of  the  multi-channel 
Delta  modulator  is  shown  in  Figure  1.  In  this 
device  the  performance  of  the  encoding  process 
is  measured  by  comparing  the  input  signals, 
S,(t).  with  what  the  modulator  believes  the  de¬ 
modulator  outputs  to  be.  These  estimates  of 
the  recovered  signals,  1^i(t),  are  obtained  by 
feeding  the  output  binit  stream  into  a  model  of 
the  demodulator.  The  differences  between 
these  signal-pairs  are  fed  through  linear 
"weighting  filters,  multiplied  by  one  of  a  set 
of  Walsh  functions,  4*t(t+  T),  and  summed  to 
form  the  composit  error  signal.  While  the 
magnitude  of  this  error  signal  represents  a 
measure  of  how  badly  the  modulator  is  perform- 


ing,  little  of  this  utilized  in  this  rather  simple 
encoder.  Rather,  in  a  manner  similar  to  that 
used  in  Delta  modulation  (hence  the  name),  the 
modulator  attempts  to  maximize  the  perfor¬ 
mance  by  selecting  at  each  clock  time  a  pulse 
of  whichever  polarity  is  required  to  drive  the 
composite  error  towards  zero. 


The  weighting  filters  are  used  to  con¬ 
struct  a  reasonable  performance  measure  from 
the  Sj(t)  -^(t)  differences.  The  weighting 
used  is  integration  plus  an  instantaneous  com¬ 
ponent  (lead)  added  to  obtain  good  rebalancing 
behaviour.  The  transfer  functions  of  these 
weighting  filters  are  proportional  to: 


W(S)  =  1  +  f 


(la) 


where  ft=  3  x  103(seconds)  1 .  (lb) 


The  reconstructed  baseband  signal  esti¬ 
mates  are  obtained  by  passing  the  output  binit 
stream,  multiplied  by  the  same  Walsh  functions 
delayed  one  clock  time,  through  linear  predict¬ 
ing  filters.  These  filters  are  used  to  obtain  the 
minimum  variance  linear  estimates  of  the  base¬ 
band  signals  at  each  clock  time  based  on  the 
preceding  multiplexer  output.  This  minimum 
variance  requirement  can  be  achieved  if  the 
impulse  response  of  the  filter  is  proportional 
to  the  autocorrelation  function  of  voice  signals 
fort  >  0.  The  filter  used  has  a  transfer  func¬ 
tion  proportional  to 


F(S)  = 


1 _ 

S  +  ft  ' 


U) 


The  impulse  response  of  this  filter, 

t  fexp  t-OOfor 
to  otherwise 


(3) 


is  a  reasonably  close  approximation  to  the  de¬ 
sired  autocorrelation  function  which  was  ob¬ 
tained  from  the  power  spectrum  of  composite 
speech  reported  by  Tarnoczy 


(cti,as)  =  j  exp  LO(t  -LT)]aj(t)oa(t)dt.  (4) 

0 

The  outputs  from  a  predicting  filter  can 
be  obtained  by  convolving  the  input  with  the  im¬ 
pulse  response  given  in  (3).  Using  the  inner  ^ 
product  defined  in  (4),  the  output  from  the  K  — 
filter  at  the  end  of  the  Pi  binits  can  be  express¬ 
ed  as: 

Si,  i  =  Sit.i-i  exp  C-OLT]+ (0K./S,)  (5) 

The  first  term  on  the  right  represents 
that  part  of  the  output  value  based  on  all  output 
binits  preceding  Pi  while  the  inner  product  re¬ 
presents  that  portion  of  the  output  due  to  the  Pi 
binits.  The  baseband  signals  will  be  effectively 
separated  if  the  ®i  'a  are  orthogonal  with  res¬ 
pect  to  this  inner  product.  In  general,  flLT  is 
much  less  than  unity,  the  kernel  in  (4)  is  ap¬ 
proximately  unity  and  the  Walsh  functions  are 
nearly  orthogonal. 

Computational  Model 

The  behaviour  of  the  Multi-Channel  Delta 
modulator  can  be  computed  from  the  discrete¬ 
time  model  shown  in  Figure  2.  In  this  model, 
the  signals  at  various  places  in  the  multiplexer 
are  represented  by  real-valued  sequences  cor¬ 
responding  to  sample  values  taken  on  the  con¬ 
tinuous  signals  at  clock  times.  The  model 
uses  only  one  of  the  N  channels  with  the  effects 
of  the  remaining  channels  being  introduced  by 
the  sequence  {h,}.  To  provide  some  continu¬ 
ity  with  the  preceding  discussions,  the  base¬ 
band  input  signal  is  represented  by  {si  ].  The 
subscript  will  now  be  used  to  indicate  a  parti¬ 
cular  member  of  the  sequence  rather  than  a 
channel,  which  it  signified  inSi(t).  This  is  no 
longer  needed  since  this  section  is  concerned 
with  the  model  of  Figure  2,  which  has  only  one 
identifiable  channel. 


The  set  of  Walsh  functions  are  used  to 
provide  the  variable  proportioning  of  transmis¬ 
sion  capacity  among  the  several  basebands. 
From  a  geometric  viewpoint,  these  functions 
can  be  considered  as  elements  in  an  L-dimen- 
sional  linear  vector  space  (under  modulo  -  2 
addition),  where  LT  is  the  length  of  the  longest 
period  of  the  functions  and  T  is  the  clock  per¬ 
iod.  If  the  N  functions  used  are  linearly  inde¬ 
pendent, they  span  an  N-dimension  linear  mani¬ 
fold  of  this  L-space. 

The  output  binit  stream  can  be  taken  L 
binits  at  a  time,  resulting  in  a  sequence  of  ele¬ 
ments,  [31 },  in  the  L-space  (all  possible  am¬ 
plitude  transitions  of  the  output  stream  and  the 
Walsh  functions  occur  at  clock  times). 


The  recursive  relationships  among  the 
sequences  are: 


e»  =  so  -  (6a) 

£o  =  bo  +  .'.So  -i  (6fc) 

xs  =  ea -Keo-i  +  xo-i  (6c) 

bo  =  SgnCxo-i  -tto-i]  (6d) 

where 

K  =  exp  t-tlT]  (6e) 

Since  bo  =  *  1,  the  peak  encoded  power 
level  is,  using  (6b), 

p  =  Max  (  so3)  =  •  (7) 


With  the  number  of  channels,  N,  suffi¬ 
ciently  large,  the  amplitude  distribution  of  the 
sum  of  the  baseband  signals  is  roughly  normal, 
in  which  case  99%  of  the  channels  will  overload 
less  than  99%  of  the  time  if  the  variance  of  the 


Define  the  inner  product: 


composite  is  at  least  8  dB  below  p.  Thus  the 
variance  of  {si  }  is  taken  to  be 

of  =  <U ?])  =  ttP  =  gffjgay  • 


Define  the  quantization  error  sequence 
{Cl),  with 
t 

€n  =  bs  -  Xa-l .  (9) 

From  equations  (6)  and  (9): 

Xn  =  8n  -  K  So-l  -  €a  .  (10) 

The  variance  of  (xj  }  ,  using  equations 
(9)  and  (10)  and  recalling  that  ((sisri]  —  Kof, 

of^  <{xis}=(l  -K a)of+of  (11a) 

where  * 

Ca  =  2  <  tbi  ( s i  -  K  si-j)  )  +  {<? }  (lib) 

Thus  (xt }  can  be  viewed  as  the  sum  of 
two  uncorrelated  sequences,  one,  with  variance 
(1  -  Ka)  of  representing  the  prediction  error 
and  the  other,  with  variance  oj,  the  quantiza¬ 
tion  error. 

The  baseband  input  signals  are  statisti¬ 
cally  independent  and  because  of  the  '.Valsh 
function  multiplication,  the  error  signals  are 
uncorrelated.  So  the  variance  of  {nt  ]  is  just 
(N -  1)  times  the  variance  of  {xi}.  So 

Oa  =  (N-  1)  C(1  -  Ka)  of  +  of  ]  (12) 

For  these  same  reasons,  the  elements 
of  {th}  are  uncorrelated  and,  in  addition,  } 
is  of  zero  mean. 

Computation  of  Quantization  Noise 

The  baseband  quantization  noise  for  var¬ 
ious  numbers  of  channels  was  computed  using 
the  computational  model  and  a  post-detection 
frequency  band  from  200  Hz  to  4  kHz.  Since 
the  computer  program  was  not,  at  the  time, 
capable  of  computing  *.he  amplitude  distribu¬ 
tion  for  the  composite  baseband  signal,  a  nor¬ 
mal  distribution  was  assumed  even  though  the 
numbers  of  channels  used  were  so  small.  In 
addition,  the  first  term  in  the  quantization 
noise  of  (lib)  was  assumed  to  be  negligibly 
small.  This  assumption  should  hold  reasonably 
well  since  (st-Kst-i)  is  small  at  the  bit  rates 
used  and  bi  is  not  too  strongly  dependent  on 
fst-K  si-i)  because  of  {ns}. 

The  computational  procedure  used  was 
to  assume  an  initial  value  for  of ,  This  value 
is  then  used  in  (12)  to  obtain  ffn  •  The  assump¬ 
tion  that  of  =  <  £ca  }  >  leads  to  a  diecrete  Ma-k- 
ov  process  and  the  transitional  and  approxi¬ 
mate  state  probabilities  can  be  obtained  from 
On  and  the  assumed  normal  distribution.  A 
new  value  for  0«  is  computed  from  the  state 


probabilities  and  the  procedure  is  repeated, 
converging  to  a  solution.  The  transitional  and 
state  probabilities  used  in  obtaining  the  final 
value  for  of  are  then  used  to  compute  the  auto¬ 
correlation  function  of  txi  },  which  in  turn  is 
used  to  compute  the  power  spectrum  of  {et }, 
or,  to  be  more  accurate,  the  integral  of  the 
power  spectrum  over  the  band  assumed  for  the 
post-detection  filter. 

The  results  of  this  are  shown  in  Figure 
3  along  with  actual  data  obtained  from  a  five 
channel  breadboard  and  the  theoretical  linear 
PCM  curve  for  comparative  purposes.  The 
"peak  signal"  was  taken  to  be  0.  5  (*-K)  a, 
which  is  the  RMS  value  of  the  maximum  mono¬ 
chromatic  tone  that  can  be  encoded  without  am¬ 
plitude  limiting. 

Concluding  Remarks 

As  can  be  seen  in  Figure  3,  the  signal- 
to-quantization  noise  is  reasonably  good  in 
spite  of  the  simplicity  of  Multi-Channel  Delta 
modulation.  The  modulator  also  offers  other 
desirable  features.  One  of  these  is  that  stand¬ 
by  channels  can  be  readily  provided  since  the 
additional  circiitry  needed  is  minimal.  This 
is  due  partly  to  the  Walsh  function  modulation 
used  to  separate  the  basebands  and  partly  to 
the  adaptive  behaviour.  The  main  effect  in 
activating  stand-by  channels  is  an  increase  in 
the  quantization  noise. 

The  spectrum  of  the  quantization  noise 
is  very  smooth  with  a  maximum  occuring  at 
from  one  to  three  kHz  depending  on  the  clock 
rate.  The  coloration  is  barely  noticeable 
aurally,  and,  in  fact,  most  listeners  take  the 
noise  to  oe  white. 

Another  feature  of  the  modulator  is  that 
the  sensitivity  to  transmission  bit  errors  is 
low,  with  a  transmission  error  appearing  as 
a  single  one-pulse  error  on  all  the  channels. 
This  also  is  a  consequence  of  using  Walsh 
functions  to  separate  the  channels.  In  com¬ 
parison,  a  single  transmission  error  in  PCM/ 
TDM  would  hit  only  one  channel  but  the  effect 
on  this  one  channel  would  be,  on  the  average, 
much  greater.  This  would  also  be  the  case  if 
address  preambles  were  used  in  the  adaptive 
multiplexer,  but  there  would  also  exist  tbs 
possibility  of  error  occuring  in  the  preamble 
causing  the  correct  code  word  to  be  directed 
to  the  wrong  channel. 

As  for  further  improvements,  our  inter¬ 
est  at  this  time  is  directed  mainly  to  the  weight¬ 
ing  functions.  Presently,  linear  weighting  is 
used,  with  the  result  that  errors  in  a  channel 
with  a  high  baseband  signal  le»  el  are  weighted 
equally  with  those  in  a  chantel  with  a  low  base- 
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Utilizing  the  Baden acher  functions  pro¬ 
vided  by  a  bistable  chain,  it  Is  possible  to 
simultaneously  synthesize  20  Walsh  functions, 
whose  normalized  and  non-no  realized  sequence 
can  be  varied.  The  device  also  provides 
coaaand  pulses  for  low-pass  ssquency  filters 
end  an  arrangenent  for  synchronization  with 
another  generator  Is  Included. 

Introduction 


Upon  confronting  the  experimental  study 
In  the  practical  possibilities  of  utilizing 
Walsh  functions  [1,  2]  in  electronics,  the 
first  problem  faced  by  the  designer  Is  that 
of  disposing  of  the  necessary  instruments. 

The  measurements  obtained  from  the  Instru¬ 
ments  will  make  possible  the  comparison 
between  the  theoretical  results  and  those 
provided  by  the  practical  application  with 
Its  Inherent  natural  limitations. 

The  applications  of  the  Walsh  functions 
in  practical  electronics  is  actually  found 
In  the  typical  Initial  development  stage  In 
the  laboratory.  The  instruments  needed  for 
the  specific  measurements  are  not  offered 
commercially,  while  on  the  other  hand  the 
practical  information  given  by  publications 
Is  scarce.  Logically  a  good  part  of  the 
available  Instruments  in  an  electronics  de¬ 
velopment  Icbcratory  finds  application  when 
one  is  working  with  Walsh  functions,  with 
the  exception  of  certain  instrtaents  con¬ 
ceived  expressly  for  sinusoidal  signals;  for 
example,  generators  and  filters  for  these 
functions. 

An  experimental  study  plan  regarding 
Walsh  function  was  startad  at  the  Electrical 
Engineering  Institute  of  the  Tucuman  National 
University.  The  first  problem  that  was  pre¬ 
sented  was,  naturally,  that  of  disposing  of 
a  Walsh  functions  generator.  In  a  previous 
development  a  generator  had  been  obtained 
that  provided  20  functions  and  cnemsrd  pulses 
for  low-pass  sequsccy  filters.  With  the  same 
generator  a  aequancy  multiple  for  three  tele¬ 
phone  channels  was  attempted  (3).  With  the 
experience  gained  In  that  first  model,  the 
second  version  of  the  Instrument  was  prepared 
as  described  In  this  current  article. 


The  second  model  differs  from  the  first, 
essentially.  In  the  Inclusion  of  certain 
characteristics  that  make  It  possible  for  It 
to  be  utilized  as  a  generator  fixed  In 
sequency  by  an  external  signal.  A  previous 
article  [4]  treated  the  theoretical  aspects 
of  the  synthesis  of  Walsh  functions  In  elec¬ 
tronics,  while  this  article  only  considers 
the  practical  points  corresponding  to  the 
development  mod  realization  of  a  generator 
for  laboratory  use. 

I.  Block  Schematic 

In  figure  la  tha  distinct  sections  of 
the  device  are  represented  in  a  functional 
schematic: 

1.  Trigger  pulses  section  -  generates 
the  pulses  to  trigger  sections  2  and  3. 
Permits  varying  the  non -normalized  sequency 
from  15  zeros  per  second  to  16,000  zeros 
per  second.  It  can  operate  as: 

a.  Free  running  oscillator. 

b.  Fixed  oscillator;  In  which  case  the 
normalized  sequency  1*11*  fixed  in 
sequency  with  an  external  signal. 

2.  Sequency  division  section  -  permits 
the  normalized  sequency  1  to  be  divided  by 
the  factors  1,  2,  4,  and  8. 

3.  Walsh  function  synthesis  section  - 
generates  simultaneously  10  odd  functions 
and  10  even  functions  with  normalized 
sequency  1  ■  1,  2,  3,. ...10. 

4.  Command  pulses  section  -  Its  objec¬ 
tive  Is  to  generate  two  pulses  that  will 
permit  the  coasund  of  an  external  circuit 
(low-pass  sequency  filter). 

To  simplify  the  description  of  the  device 
It  Is  convenient  to  discuss  first  a  funda¬ 
mental  model  that  consists  only  of  the  Walsh 
function  synthesis  section  and  the  oscillator 
section  (Figure  lb).  A  later  step  will  con¬ 
sider  the  aggregate  of  the  sequency  division 
section  and  the  command  pulse  generator 
section.  Therefore,  that  which  follows  will 
use  this  order  for  discussion. 


II.  Walsh  Function  Syntheala  Section 

The  adopted  [X]  acheae  of  generation 
Indicated  in  Figure  2  permit*  obtaining  10 
odd  functlone(  sal  (i,  6),  and  10  even 
functiona,  cal  (1,  6),  with  normalized 
sequency  1  ■  1,  2, ....10. 

The  bistable  chain  (bistables  B0  to  B5) 
delivers  sal  (2k,  0)  4  A  cal  (0,  0)  by 
having  utilized  bistables  whose  voltage  vary 
between  a  value  near  zero  and  aoae  positive 
voltage.  It  is  convenient  to  note  that  if 
one  supposes  that  an  output  of  one  bistable 
(i.e.  BO  delivers  one  voltage  A  cal  (0t  0) 

+  sal  (2*,  6)  the  complementary  output  Bk  will 
deliver  the  voltage  A  cal  (0,  0)  -  sal  (2k,  6). 

Starting  from  the  Hademacher  functions 
sal  (2k,  9)  it  is  possible  to  synthesize  the 
Walsh  functions  effecting  products  of  Bade- 
macher  functions.  Therefore,  it  is  necessary 
to  accomplish  electronically  the  product 
operation  of  normalized  Walsh  functions,  of 
which  sal  (2k,  0)  are  a  particular  case. 

A  Walsh  function  takes  only  4-1  or  -1 
values.  The  product  of  two  functions  will 
therefore  be  41  if  both  are  of  the  same 
sign  in  a  certain  time;  and  if  that  condition 
is  not  met  it  will  be  -1.  The  factor  func¬ 
tions  as  well  as  the  product  function  can  > 
take  only  two  well  defined  values,  which 
makes  it  possible  to  utilize  binary  algebra. 
Let  the  product  of  two  functions  be  Wj  and 


W2.  For 

them  we  < 

can  make  the  following 

truth  tables: 

(a) 

(b) 

(c) 

Wi  W2 

W« 

«1 

w2 

«b 

W1 

«2 

wc 

4  4 

4 

1 

1 

1 

0 

0 

0 

- 

4 

0 

0 

1 

1 

1 

0 

4 

- 

1 

0 

0 

0 

1 

1 

-  4 

- 

0 

1 

0 

1 

0 

1 

Table  (a)  refers  to  the  slgna  of  the 
product  of  two  Walsh  functions,  table  (b) 
to  the  corresponding  logic  function  if  a 
41  (Walsh  function)  is  taken  as  equivalent 
to  a  logic  1,  and  a  -1  equivalent  to  a 
logic  0,  while  table  (c)  indicates  the 
logic  function  if  a  -1  is  tsken  as  equivalent 
to  a  logic  1  and  41  equivalent  to  a  logic  0. 
For  tables  (b)  and  (c)  one  has: 

(b>  W),  -  WjVj  4  WjVj 

(c)  Wc  -  WxW2  4  VXW2 

These  expressions  are  implemented  with 
digital  gates ;  both  variables  require  dispos¬ 
ing  of  the  binary  variable  and  its  complement 
(negation) .  It  is  opportune  to  note  that 
while  the  (b)  expression  provides  tbs  de¬ 
sired  Walsh  function,  expression  (c)  also 
provides  it,  but  delivers  the  function  with 
e  changed  zign.  Strictly  speaking,  the  out¬ 


put  of  the  gatea  la  equal  to  a  poaitlve  con¬ 
stant  plus  the  product  function  (case  b)  or 
leas  the  product  function  (case  c). 

In  figure  2  are  indicated  in  aynboilc 
form  (the  circles  represent  the  product 
operation)  the  operations  that  must  be  im¬ 
plemented  to  obtain  each  function,  for  which 
a  unique  standard  circuit  is  utilized, 
excited  just  as  Inferred  by  the  expression 
(b)  or  (c).  The  utilization  of  one  or  other 
variable  ie  a  question  of  practical  conven¬ 
ience,  the  only  detail  that  must  be  observed 
in  essence  ie  the  fact  that  the  function  must 
appear  in  the  series  with  the  correct  sign. 

Between  the  direct  outputs  of  the  bi- 
atables  and  the  gates,  one  has  20  Walsh- 
functions.  These  signals  are  taken  to 
20  separating  amplifiers  designed  in  such 
a  form  that  an  eventual  short  circuit  at  the 
at  the  output  of  the  amplifiers  does  not 
produce  any  harm  neither  in  the  amplifiers 
nor  in  the  integrated  TTL  circuits  utilized 
in  the  logic  (bistables  Texas  SN5474  and 
gatea  Texas  SN5450  and  SN5400). 

Prior  to  passing  the  signals  through  the 
separating  amplifiers,  the  20  Walsh  functions 
are  taken  to  a  connector  situated  at  the 
rear  panel  of  the  device.  In  the  front 
panel  there  are  two  keys  of  10  positions 
each,  Channel  A  and  Channel  B,  Bad:  key 
allows  to  chcose  simultaneously  the  even 
function  and  the  odd  function  for  a  given 
aequency  (i  -  1,  2,... 10),  with  output#  for 
the  function  with  the  correct  sign  or  with 
the  changed  sign.  In  addition,  the  signal 
-■•l  (1,8)  ia  taken  to  a  BNC  connector  on 
the  front  panel,  to  be  utilized  as  a  syn¬ 
chronizing  signal  for  an  oacilloscope. 

III.  Trigger  Pulses  Section 

Figure  3  presents  the  schematic  of  the 
principle:  of  this  section.  The  rectangle 
marked  (1)  symbolizes  an  oscillator  controlled 
by  voltage.  It  is  of  the  LC  type,  utilizing 
a  variable  capacitance  diode  to  obtain  fine 
frequency  adjustment  through  the  action  of 
a  control  voltage  coning  from  the  phase  com¬ 
parator  (4)  and  the  low-pass  filtar  (3).  By 
msaos  of  s  variable  capacitor,  whose  axis  is 
controlled  from  tbs  front  panel  of  the 
device,  it  ie  possible  to  vary  the  freqmency 
of  the  oscillator  between  4B0  KBc  and  1100  KBr. 
The  circuits  described  permits  two  modes  of 
operation:  s)  as  a  free  oscillator,  and 
b)  ws  an  oscillator  controlled  by  voltsga. 

If  one  desires,  it  is  possible  to  use  an 
external  oscillator  as  a  substitute. 

It  is  cotmolent  to  consider  first  tbs 
csss  of  the  free  running  oscillator  (or 
using  so  external  oscillator).  Tbs  slpuls 
from  the  oscillator  (latarnel  or  external) 
pasa  through  block  (2)  which  is  t  separating 
amplifier  and  limiter;  end  furnish  trigger 
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pulses  to  th«  chain  of  9  blatabli  (Texas 
5R5474)  Indicated  syahollcally  aa  *17,. . . 

®13»* 

Tha  output  of  circuit  (2)  and  the  outputs 
of  tha  9  bistable*  ana  taken  to  a  10  position 
switch  L]>,  that  peraits  select  lap  sisals 
whose  sequancy  la  siller  as  the  switch  no  is 
to  the  bistable*  of  tha  loir  subscripts. 

It  has  been  stated  that  as  a  first  step 
It  would  be  asswasd  that  the  tripper  pulses 
seer ion  would  be  connected  directly  (Flp  lb) 
to  the  synthesis  section.  This-  nods  of 
operation  presents  Itsalf  In  one  sf  the 
applications  of  the  device;  l.e.  whan  tha 
asqmey  division  factor  is  equal  to  1  (we 
paragraph  5).  In  Ala  case,  between  the 
synthesis  section  (1  bistable*)  and  tha 
tripper  pels**  faction  (9  bistab laa)on*  can 
dispose  of  a  total  of  IS  bis  tab  1m.  If  all 
the  bistable*  of  this  last  section  are 
utilised,  the  s aquae cy  of  the  signal  sal 
(1.  P)  provided  by  the  Bq  bistable  will 
be  1/215  of  the  sequancy  of  the  oscillator; 
that  Is.  it  will  be  possible  to  vary  the 
sal  (1,  •)  sequancy  approximately  between 
15  same  per  second  to  33  aeroe  per  aeoond. 

lelnp  bothered  to  work  with  division 
factors.  It  waa  chosen  to  eMlgn  to  the  os¬ 
cillator  (front  panel)  a  nominal  sequancy  of 
15  to  30  saros  per  second  and  to  nark  the  Lq 
switch  (front  panel)  with  multiplication 

factors  2°,  21 . 29,  as  It  is  shorn  on 

PI  pure  3.  The  sal  (1,  *)  signal  provided  by 
the  B0  bistable  Is  tdtan  to  e  BBC  connector 
located  on  the  rear  panel,  which  permits 
the  utilisation  of  a  digital  frequency -iter 
to  determine  (if  It  wee  necessary)  the  non- 
nomallsed  sequancy  of  sal  (1,  •),  and  which 
In  conclusion,  can  be  varied  between  15  aero* 
par  second  and  slightly  nor*  than  16,000 
saros  per  second.  If  an  external  oscillator 
Is  used,  the  signal  fro*  lo  can  have  as  lew 
a  sequancy  as  desired,  and  as  high  as  the 
bistable*  utilised  will  permit. 

Is  using  always  tha  connection  of  the 
Fig use  lb,  the  following  will  dlacusa  the 
operation  of  the  oscillator  whan  It  is  syn¬ 
chronised  by  an  external  signal  (Figure  3) . 

For  this  operation  It  is  ices* try  to  taka 
the  synchronising  signal  and  the  -sal  (1,  •) 
alpaal  provided  by  tha  Bo  blatabla  (aynthssls 
taction)  to  tha  two  inputs  of  a  blatabla 
(BPL9923)  that  acta  at  a  phase  conparetor 
(4).  To  be  capable  of  triggering  the  bistable, 
the  signal  from  B0  must  be  previously  diffsr- 
sntlatsd  by  neons  of  circuit  (5);  while  tha 
external  signal  can  first  pass  throu^i  a  good 
limiter  anpllfisr  and  than  be  diffarse.iated; 
operations  which  correspond  to  block  (6)  of 
Figure  3. 

Tbs  aggregate  of  tripper  pulses  and 
synthesis  sections  operate  1  a  phase-locked 


loop*;  a  subject  over  which  there  is'aapl* 
bibliography.  In  reference  [5],  that  subject 
is  discussed  relative  to  the  utilisation  of 
a  divider  chain.  In  order  to  operate  using 
a  synchronising  signal,  tha  B0  signal  is 
taken  to  a  frequency  dost  to  tha  fundamental 
sequancy  of  the  external  signal.  This  is 
accomplished  by  actuating  switch  ip  and  the 
variable  capacitor  of  the  oscillator  to 
bring  the  device  into  a  synchronising  cap¬ 
ture  soi.  With  a  small  variation  of  the 
variable  capacitor  it  is  possible,  if  on* 
desires,  to  obtain  coincidence  of-xero 
crossings  between  the  synchronising  slgcal 
and  the  sal  (1,  6)  signal;  and  also,  to 
obtain  null  tli  delays  between  both  signele. 
•witch  Lp  is  in  reality  a  switch  with  two 
coanutator  sections,  01  of  then  for  the 
multiplication  factor  already  explained,  and 
tha  other  to  coanutat*  capacitors  and  to  vary 
tha  1C  constant  of  the  low-pass  filter  (3). 

IT.  Connend  Fulaaa  Section 

This  part  of  the  device  haa  aa  its  ob¬ 
jective  to  control  a  low-pars  aaquency 
filter  [1],  that  1*  an  alien  arrangement 
to  the  generator  per  se,  and  which  needs  to 
b*  synchronised  with  the  generator  for  ita 
operation  in  receiving  command  pulses. 

In  auccint  form  tha  work  cycle  of  a  low- 
pis  sequancy  filter  (Figure  5)  is  the 
following:  The  Input  algnel  F(0)  1*  inte¬ 
grated  during  tli  T;  at  the  end  of  the 
Integration  interval  the  output  voltage  of 

integrator  is  trmsfemd  to  aanoxy 
capacitor  C*,  for  which  switch  by  gosa 
from  position  1  (position  for  tha  integra¬ 
tion)  to  position  2  (transfer).  Iiediately , 
the  switch  goes  to  position  3  (erased) , 
taking  the  integrator  to  its  initial  con¬ 
ditions  to  begin  e  new  integration  interval 
(switch  to  position  1).  The  connotation  of 
the  switch  is  realised  in  actual  practice 
with  two  emend  pulses. 

Lot  Bj_  ts  tha  puli  that  data  mines  the 
transfer  of  the  information  to  the  memory 
capacitor,  and  let  B2  b*  the  erasure  pulse. 
To  minimis*  the  error  both  operations  moat 
be  performed  in  the  least  possible  tli,  and 
Bj  must  appear  Immediately  after  B* . 

The  previous  at ataman  ts  are  ideal  con¬ 
ditions  which  must  b*  reconciled  with  tboe* 
of  tha  practical  behavior  of  the  lew-pass 
filtsr  that  is  to  be  controlled. - 

•In  an  earlier  irk  [4]  it  was  stated  that 
it  did  it  nake  seal  to.  talk  about  phai 
difference  for  Walsh  functions,  so  that  for 
the  present  case  it  would-be  correct  to 
refer  to  s  sequency-locked  loop,  end  to  cell 
tbs  phai  coaparator  (bistable)  as  a  tli 
delay  coaparator. 
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The  cosngnd  pulses  (Figure  6)  ere  and 
Bg;  end  both  have  a  duration  (high  positive) 
of  t«T/64,  where  X  is  the  integration  interval 
corresponding  to  the  sal  (1,  6)  periodic 
interval,  just  as  it  is  explained  further 
ahead  (paragraph  5).  The  triggering  of  the 
Bj  pulse  can  be  realised  for  9—1/2  or  6-0, 
selectable  by  naans  of  switch  L  (front  panel). 
Fulse  B2  is  present  ianediately  after  pulse 
Bl.  Figure  6  includes  a  schematic  of  the 
logic  used  (blstables  Texas  SN5474  and  gates 
Texas  SM5400  used  os  inverters,  N) .  Pulses 
Bi  and  B2  and  their  conplenents  Bi  and  Bg 
and  taken  through  separating  amplifiers  to 
the  front  panel  and  to  the  connector  located 
in  the  rear  panel,  which  is  the  sane  connector 
where  the  20  functions  fron  the  synthesis 
section  also  meet. 

V.  Ho  realised  Sequencv  Division  Section 

In  the  entire  discussion  that  preceded, 
it  was  assumed  that  bistable  B0  (synthesis 
section)  corresponde  to  the  unitary  sequency , 
providing  sal  (1,  9).  Multiplying  the 
oscillator  sequency  (IS  to  30  seros  per 
second)  by  the  multiplication  factor  (see 
paragraph  3)  one  obtains  the  son-normalised 
sequency  for  the  B0  bistable. 

It  has  been  seated  that  in  the  low-paae 
sequency  filter  the  (theoretical)  inte¬ 
gration  interval  must  correspond  to  the 
repetition  interval  T  of  the  sal  (1,  9) 
function. 

For  the  behavioral  trial  of  a  low-pass 
sequency  filter  it  is  convenient  to  dispose 
of  signals  with  fractional  sequency.  This 
la  obtained  by  means  of  the  sequency  div¬ 
ision  section,  which  is  Inserted  (Figure  la) 
between  the  trigger  pulses  section  and  the 
synthesis  section. 

The  sequency  division  section  simply 
consists  of  three  bistables  (*g  to  »8> 
connected  as  dividers  by  factors  of  two. 

When  the  device  operates  with  sequency 
division  factor  equal  to  1  those  blstables 
are  not  used.  If  it  is  desired  to  operate 
with  sequency  division  factors  of  2,  4,  or  8 
the  necessary  blstables  are  inserted,  by  means 
of  a  switch  labeled  sequency  division  factor 
(front  panel).  In  this  case  one  must  keep 
in  mind  that  the  normalised  sequency  which 
are  indicated  by  the_  mashers  located  together 
with  the  knobs  of  the  lO  position  switches 
(channel  A  and  channel  B)  described  in 
paragraph  2,  must  be  related  to  the  mentioned 
factor  of  sequency  division.  For  example, 
sal  (7,  9)  will  corrsa pc-* d  to  sal  (7,  9)  if 
it  is  operating  with  sequency  division  factor 
equal  to  1,  but  lt  will  be  sal  (7/8,  9)  if 
it  is  operating  with  division  factor  of  8. 


filters;  for  that  operation,  the  switch 
labeled  sequency  division  factor  must  also 
perform  the  necessary  coarctations  so  that 
in  every  case  the,  command  pulues  will  ful¬ 
fill  the  specifications  defined  in  paragraph 

4. 
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The  previous  discussion  really  has 
physical  meaning  only  if  it  is  joined  with 
tbs  command  pulses  for  low-pass  sequency 
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FIGURE  7.  REAR  PANEL  OF  THE  GENERATOR 


FIGURE  8.  GENERATOR  VIEW 
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TOTAL  ORTHOGONALITY  ERROR  OF  THESE  GENERATORS. 
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1.  Introduction. 

The  large  number  of  papers  on  sequen- 
cy-technics,  which  appeared  during  the 
last  few  years,  proves  the  increasing 
importance  of  this  subject.  When  rea¬ 
lizing  sequencv  systems,  as  coders  or 
decoders,  the  development  of  Walsh- 
function  generators  is  a  special  pro¬ 
blem.  Such  generators  must  comply  with 
the  following  requirements: 

To  be  capable  of  producing  a  large  num¬ 
ber  of  Walsh-functions  simultanously 
and  to  permit  an  expansion  from  m  to 
2i*m  functions. 

To  effect  only  a  small  orthogonality 
error  in  the  system  of  generated  func¬ 
tions  up  to  high  clock  frequencies. 

The  binary  structure  of  the  Walsh-func¬ 
tions  gives  reason  to  develop  the  gene¬ 
rator  with  digital  IC's.  To  keep  the 
costs  low.  Standard  TTL-IC's  should  be 
prefered  for  the  realization. 

The  orthogonality  error  is  a  crite¬ 
rion  for  the  efficiancy  of  generators 
producing  orthogonal  functions.  It  is 
brought  about  by  three  facts:  1.  the 
displacement  between  two  functions 
caused  by  propagation  delays  in  IC's, 

2.  the  tolerances  of  the  propagation 
delay  time  and  3.  the  difference  be¬ 
tween  rise  and  fall  times  of  most  IC's. 

Varying  output  voltages  of  different 
IC's  may  be  equalized  by  operational 
amplifiers  and  therefore  don't  affect 
the  orthogonality  error. 

2.  Walsh-function  generators 
and  their  properties. 

One  of  the  possible  arrangements  of 
Walsh-functions  in  the  normalized  time 
interval  -  1/2  <  8  <  1/2  resulting  from 
tho  difference  equation  of  Harmuth  [  l] 
is  shown  in  figure  1.  The  same  figure 
shows  Walsh-functions  in  the  normalized 
time  interval  0  <  9  <  1  (6  is  the 

time  normalized  on  the  orthogonality 
interval  length  T  ) .  Two  of  the  genera¬ 
tors  later  discussed  may  be  switched 
over  from  one  time  base  to  the  other. 


wol  (0001.8) 


Fig.  1:  Arrangement  of  Walsh-functions 
fer  two  time  bases 

2.1  Hitherto  existing 
Walsh-function  generators. 

In  1968  Harmuth  [2]  proposed  a  gene¬ 
rator  for  Walsh-functions,  which  is  re¬ 
ported  in  practical  use.  The  idea  of 
his  concept  is  based  on  the  multiplica¬ 
tion  theorem  of  Walsh-functions. 

wal  (i,8)»  wal(  j ,9)  =  wal(i©j,8) 

©  denotes'  the  bit  per  bit  mod  2  addi¬ 
tion 

For  generating  2n  Walsh-functions  he 
first  produces  n  Rademacher  functions 
as  output  waveforms  of  a  n-stage  binary 
flip-flop  counter.  The  remaining 
2n-(n+l)  functions  are  obtained  by  ta¬ 
king  all  possible  mod  2  sums  of  the  di¬ 
gital  Rademacher  functions: 

♦(?)♦(;)  ♦•••♦(:) 

The  1  denotes  the  Walsh-function  wal 
(0,9)  and  (J)  specifies  all  possible 
combinations  of  i  elements  out  of  n 
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without  repetition.  Figure  2  shows  the 
realization  of  the  "Harmuth"-generator 
with  counter  flip-flops  and  halfadders 
for  n  =  4. 


In  1970  Lebert  £3J  presented  a  gene¬ 
rator  producing  a  large  number  of  diffe 
rent  sequencies.  It  is  also  possible  to 
change  the  time  base;  see  figure  3. 


Fig.  2:  "Harmuth"-Walsh  generator  (n=4) 

Disadvantages  of  this  generator  are; 

The  displacement  of  the  Rademacher  func¬ 
tions  wal(l,0)  and  wal(2n-l,9)  amounts 
to  ti  =  (n-l)Tz  if  an  asynchronous 
counter  is  chosen  (tz  is  the  propaga¬ 
tion  delay  of  a  counter  flip-flop) . 

Some  other  Walsh-functions  are  further 
delayed  up  to  (n-l)Tjj  while  passing 
halfadders  (t«  propagation  delay  of  a 
halfadder) .  If  the  asynchronous  counter 
is  replaced  by  a  synchronous  counter, 
the  maximal  time  lag  between  two  func¬ 
tions  is  reduced  to  T2=Axz+ (n-1)  tjj  {At* 
is  the  difference  of  the  risetimes  of 
two  counter  flip-flops) .  Maximal  clock 
frequencies  under  worst  case  condit  .ons 
are  f  1=l/3  (tz+th)  )  “  5  Me  for  a  gemra- 
tor  with  asynchronous  counter  (n=4)  and 
f 2=1/ ( Atz+3th)  ~  10  Me  for  a  generator 
with  synchronous  counter  (n=4)  respec¬ 
tively. 


Fig.  3;  "Lebert"-Walsh  generator  (n=4) 

The  elaborateness  of  digital  IC's  in¬ 
creases  rapidly  if  one  wants  to  generate 
more  than  one  function  simultanously . 

For  2n  Walsh-functions  the  whole  circuit 
except  the  counter,  must  be  duplicated 
2n-2  times.  In  Leberts  design  the  nega- 
tJve  edges  of  the  Rademacher  functions 
produce  triggering  pulses  when  passing 
through  differentiators.  A  particular 
amount  of  these  pulses  is  combined  by 
OR-gates  and  used  to  trigger  an  output 
flip-flop.  The  maximal  time  lag  between 
two  functions  is  giver,  by  T3=(n-l)xz  + 
Ator+Atrc+Atnor+AtfF  or  t4=Atz+At0R  + 
ATj^+ATj^+Aipj,  dependent  from  the  choo- 

sen  counter  (Ator,  AtRc«  AtN0R'  AtFF 
are  propagation  delay  time  differences 
of  two  OR-gates,  two  differentiators, 
two  NOR-gates  and  two  flip-flops) .  Fur- 


ther  delays  in  the  time  base  have  not 
been  considered.  Maximal  worst  case 
clock  frequencies  of  the  "Lebert"  gene¬ 
rator  are  «  I/T3  »  7  Me  (n=4)  and 
£4  “  I/T4  15  Me  (n=4)  . 

A  Walsh-function  generator  develop- 
ped  by  Yuen  £43  is  shown  in  figure  4 . 
The  circuit  is  a  modified  version  of 
the  "Lebert"  generator.  The  differenti¬ 
ators  are  replaced  by  AND-gates  which 
also  have  the  task  to  synchronize  func¬ 
tion  generation  by  clock  pulses.  Fur¬ 
thermore  Yuen  uses  a  special  counter. 
The  maximal  displacement  between  two 
produced  Walsh-functions  is  given  by 
t5  =  £tnand  +  tqr  +  tff.  It  must  be 


Fig.  4:  "Yuen'-Walsh  generator  (n-4) 

noted  that  the  propagation  delay  time 
of  the  OR-gate  must  be  calculated  from 
the  sum  of  the  propagation  delays  of  a 
NOR-  and  a  NAND-gate,  as  OR-gates  with 
four  inputs  are  not  available  in  Stan¬ 
dard  TTL,  The  generator  can  be  driven 
under  worst  case  conditions  with  the 
clock  frequency  fc  =  l/(2d+TFF+(n-2)TANt} 
«12  Me  (n=4)  (d  is  the  length  of  the 
clock  pulse) .  This  frequency  is  deter¬ 


mined  by  the  counter  alone. 

2.2  New  Walsh-function  generator 
using  multiplexers. 

In  this  paper  we  outline  the  design 
of  a  Walsh-function  generator  consist¬ 
ing  only  of  counter  flip-flops  and  mul¬ 
tiplexers.  For  producing  2n  Walsh-func¬ 
tions  one  needs  2r—  1  multiplexers.  Each 
of  the  2n/k  inputs  of  a  multiplexer  is'_ 
switched  k-times  to  the  output  in  each 
interval  T.  Some  input  signals  must  be 
changed  in  their  logical  value  with  t.ie 
frequency  f  =  2'v“n)»fc  if  v  4  0.  Fur¬ 
ther  one  needs  n-v  counter  flip-flops 
and  m  additional  gates. 

{0  v  <  1 

2V  M  v  >  1 

Later  we  shall  evaluate  which  values 
for  v  are  significant. 

The  structure  of  this  generator  is 
shown  in  figure  5  for  n=4  and  v=0. 


Fig.  5:  "Multiplexer "-Walsh  generator 
(n=4,  v=0) 

Incrementing  the  counter  by  1  at  each 
clock  pulse  one  multiplexer  input  after 
the  other  is  switched  to  the  output. 

The  desired  time  base  is  obtained  by 
choice  of  the  input  signals.  In  the 
same  manner  all  2n  Walsh-functions  can 
be  generated  by  one  multiplexer  in 
chronical  sequence.  Attention  must  be 
paid  to  the  fact  that  some  multiplexers 
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invert  the  input  signals  . 

A  simultanous  generation  of  m  <_  2n  =  16 
Walsh-f unctions  (figure  5)  is  accom¬ 
plished  by  connecting  in  parallel  m-1 
multiplexers  with  16  inputs.  The  maxi¬ 
mal  time  lag  between  two  Walsh-func- 
tions  comes  to  Tg  =  (n-l)xz+AT(4  when 
operating  with  an  asynchronous  counter 
and  to  T7  =  Atz+Atm  when  operating  with 
a  synchronous  counter  (Atm  is  the  pro¬ 
pagation  delay  time  difference  of  two 
multiplexers) .  Maximal  worst  case  clock 
frequencies  are  fg  =  1/(3tz+tm)  «*7.5  Me 
(asynchronous  counter  and  n=4,  v=0)  and 
f7  =  l/fAt^Tn)  »  20  Me  (synchronous 
counter,  independent  of  n,  v=0) . 

Now  the  operation  of  the  "Multiple¬ 
xer"  generator  is  discussed  for  v=l. 
Figure  6  shows  one  possible  realization 
(n=4)  . 

I - 1 

I  ! 


wot  {0001.8} 


wal  (l!il, 8) 

Fig.  6;  "Multiplexer"-Waish  generator 
(n-4,  v=»l) 

The  16  line  co  1  line  multiplexer?  are 
replaced  by  8  line  to  1  i  ine  multiple¬ 
xers  JV3  a  3  bit  binary  counter  is  now 
sufficient  one  flip-flop  may  be  used 
otherwise.  The  counter  must  run  twice 
from  0  to  7  to  get.  the  16  output  levels 
for  one  Walsh-f vnet.8 on.  Each  time  the 
Counter  has  reached  the  decimal  eight 
the  input  signals  of  some  multiplexers 
must  be  changed  in  their  logical  level. 


Figure  6  shows  an  example  of  solving 
this  problem  by  means  of  flip-flop  FF4. 
When  producing  the  function  wal (1,0)  in 
the  normalized  interval  -1/2  <_  0  <  1/2 
the  output  signal  of  the  multiplexer 
must  change  to  logical  1  after  (2m+i/3 
clock  pulses  and  to  logical  0  after 
2m- 8  clock  pulses  (m<*0 ,1 , . . .)  .  FF4  just 
changes  its  output  level  in  this  manner 
and  is  therefore  connected  directly  to 
all  inputs  of  the  multiplexer  MP1.  The 
number  of  multiplexers  whose  input  sig¬ 
nals  must  be  changed  is  calculated  as 
follows:  If  the  Walsh-function  wal(i,6) 
produced  by  MP  i  is  periodic  with  Tn/2 
(Tn  is  the  normalized  tinw  interval) 
then  the  input  signals  of  MP  i  remain 
unchanged,  otherwise  they  have  to  be 
changed.  The  normalized  sequency  [2]  of 
these  functions  is  an  even  number,  and 
runs  up  to  2n~l.  Therefore  the  input 
signals  of  b(v*l)  *  2n~l  multiplexers 
must  be  changed. 

The  replacement  of  the  large  multiple¬ 
xers  by  smaller  ones  does  not  bring  up 
any  disadvantages.  On  the  contrary  ad¬ 
vantages  are  achieved:  Maximal  clock 
frequency  remains  constant,  costs  and 
occupied  space  decrease  to  50  %. 

Choosing  v=2  results  in  the  circuit 
shown  in  figure  7  (n-4) .  Two  of  the 
counter  flip-flops  are  no  longer  used 
directly  for  counting.  That  is  indica¬ 
ted  in  the  figure  by  separating  them 
from  the  others  by  a  dashed  line. 


Fig.  7:  "Multiplexer "-Walsh  generator 
(n*4,  v=2i 


The  number  of  switching  points  where 
some  input  signals  must  change  its  lo¬ 
gical  values  increases  from  two  (v-l) 
to  four.  These  four  switching  points 
can't  be  determined  by  two  counter  flip- 
flops.  The  requirement  of  one  additio¬ 
nal  gate  arises  here.  This  additional 
gate,  exactly  a  half adder, causes  a  pro¬ 
pagation  delay  time,  which  decreases 
the  maximal  clock  frequency.  Now  it 
holds  fs  -  1/(3t_+tm+Th)  -a  6  Me  (asyn¬ 
chronous  counter)  and  fg  =  1/(tm+tu+At2) 
«13.5  Me  (synchronous  counter)?  The 
costs  are  still  decreasing  by  this  ope¬ 
ration  as  well  as  the  occupied  space. 

Enhancing  v  to  3  will  result  in  an 
increasing  number  of  additional  gates 
and  a  not  desired  decrease  of  the  clock 
frequency  below  10  Me. 

Summarizing  we  state  that  it  is  rea¬ 
sonable  to  build  up  the  generator  with 
a  factor  v  *  2  or  v  *  1.  The  factor 
v  ■=  2  permits  to  develop  generators  for 
64  different  Walsh- functions,  using 
todays  available  multiplexers (lC  line 
to  1  line)  without  cascading. 

3,  Orthogonality  error  of 
Walsh  generators. 

A  well  known  measure  to  compare  the 
features  of  different  Walsh  generators 
is  the  orthogonality  error  of  the  pro¬ 
duced  functions.  Dealing  with  logical 
levels  (0  and  1)  a  possible  definition 
is: 

*  |4_£  (wald(i,8)-i/2). 
(wald(j,0)-l/2)d6-6lf jl  (#) 

where : 

wald(i,0) :=l/2 (wal (i,0) +1) 

5i,j:=  {£  ijj 

Tn:  normalized  orthogonality  interval 
(mainly  Tn*l) 

0  :  on  T  normalized  time 


counter 


logical 

operations 


Equ.  (♦)  shows,  that  j  is  only  diffe¬ 
rent  from  zero  if  i+j ,  a  constant  dis¬ 
placement  of  all  21*  functions  against 
the  interval  borders  does  not  affect 
the  orthogonality  error. 

Circuits  of  Waleh-f unction  genera¬ 
tors  may  be  decomposed  into  three  se¬ 
parate  stages,  see  figure  8. 

First  a  counter  stage  -  or  modified 
counter  stage  (Yuen)  -  second  a  stage 
where  logical  operations  are  performed 
and  third  a  stage  with  output  gates. 


output 

gates 


wal(ijkl.8) 


Fig.  8:  Block  diagram  of  a  Walsh  gene¬ 
rator  and  orthogonality  error 

Analog  to  the  decomposition  of  the  ge¬ 
nerator  the  orthogonality  error  is  cal¬ 
culated  in  three  parts.  The  first  part 
is  found  under  the  assumption  that  the 
circuit  is  built  up  out  of  a  real  coun¬ 
ter  and  ideal  gates  (no  delay)  in  the 
second  und  third  stage.  The  "counter" 
error  is  reasoned  in 

a)  different  rise  and  fall  times  of 
counter  flip-flops  and  tolerances  of 
rise  and  fall  time  of  counter  flip- 
flops  (time  lag  At2)  , 

b)  propagation  delay  when  using  an  asyn¬ 
chronous  counter  (time  lag  (n~l)rz). 

The  second  part  arises  from  the 
assumption,  that  counter  flip-flops  as 
well  as  output  gates  are  ideal  and  that 
real  gates  are  taken  for  the  logical 
operations  in  the  eecond  stage.  This 
"logical"  error  is  caused  by  the 
different  number  of  gates  which  trigge¬ 
ring  signals  must  pass  to  produce  diffe¬ 
rent  Walsh-f unctions  (time  lag  t^)  and 
the  difference  of  rise  and  fall  times 
and  its  tolerances  of  these  gates  (time 
lag  Atl)  . 

At  lasc  the  third  part  arises  from 
the  assumption  of  an  ideal  counter 
stage,  ideal  logical  operations  stage 
and  real  output  gates.  This "output" 
error  is  reasoned  in  the  differing  rise 
and  fall  times  and  its  tolerances  of 
the  output  gates  (time  lag  Atg) . 
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Abstract 

In  biology  and  medicine  a  systems 
description  in  discrete  form  is  manda¬ 
tory  and  can  be  based  on  a  Boolean 
algebra  maintaining  a  quantitative  and 
deterministic  relationship  between  the 
variables.  In  contrast  to  previous  ap¬ 
proaches  ( GANN t6CH0EFFLER) .the  mapping 
of  the  logic  systems  description  into 
a  set  of  orthogonal  functions  over  a 
Galois  field  leads  to  computational  ad¬ 
vantages.  The  applicability  of  the 
mathematical  technique  to  biological 
systems  description  is  demonstrated  by 
the  human  female  reproductive  cycle  as 
an  example. 

Introduction 

In  biology  and  medicine  systems  des¬ 
cription  serves  the  purpose  of  summa¬ 
rizing  our  knowledge  of  a  system.  A 
mathematical  representation  can  help 
to  check  a  complex  hypothesis  or  to 
predict  results  by  simulation.  There¬ 
fore  (empirical)  data  and  (theoretical) 
assumptions  must  be  incorporated  in  a 
mathematical  model. 

Empirical  information  of  a  system 
can  only  be  obtained  by  observables 
and  be  represented  by  a  sequence  of 
discriminatory  states  and  a  diagram 
of  information  flow  together  with  the 
memory  depth  of  the  system.  This  repre¬ 
sentation  of  data  can  be  extended  by 
assumptions  to  meet  a  certain  hypothe¬ 
sis  or  to  fill  a  gap  of  knowledge. 

As  we  want  a  definite  answer, 
decision,  or  feedback  by  a  simulation, 
only  deterministic  systems  are  of 
interest.  By  Heisenberg’s  principle  of 
indeterainancy  measurements  yield  only 
discrete  data  of  finite  resolution,  if 
we  exclude  any  probabilistic  statements. 
For  the  same  reason  only  disjoint  equi¬ 
valence  sets  of  state  variables  xi(t), 
i  «  1,2,3,...,n  and  state  sequences 
t  -  1,2,3,...  are  allowed.  Thus  the 
model  of  the  system  is  conceived  as  a 
deterministic  finite  automaton  or  se¬ 
quential  machine. 

supported  by  a  fellowship  of  the  Deutsche 
NIH  Grant  AM  14952  (D.S.G.). 


Mathematics 

A  deterministic  systems  description 
can  be  obtained  by  assigning  discrete 
variables,  i.e.  two-valued  Boolean 
functions  x. (t)  to  the  observables 
( GANN , SCHOEFFLER ) .  To  •  ~v  qualitative 
observable  -  with  the  .  jt  order  of 
resolution  -  only  one  Boolean  function 
is  attributed,  whereas  quantitative 
observables  x(t)  are  quantized  by  the 
dyadic  expansion  into  several  two-val¬ 
ued  functions  xi(t): 

x(t)A  ^'^(t).  (1) 

i-1  1 

t-1,2,3,.,.,211  is  the  attributed  state 
out  of  the  state  sequence. 

A  complete  state  description  in  the 
discrete  variables  x-(t),i»1,2,...,n 
at  the  state  t  is  obtained  by  an  ele¬ 
mentary  Boolean  conjunction 

y(t)  «  S  X?(t)  (2) 

i«1  1 

with  i«1,2,...n;  x£«  x^  or  x^  and  with 

the  operatorsA"AND"_(u8ually  written  as 
concatenation)  and  x  as"NEGATION"  of  x. 

Thus  in  a  system  with  n  variables 
maximally  2r  different  states  can  be 
observed  forming  the  same  number  of 
elementary  conjunctions.  The  system  is 
called  to  be  of  n-th  order. 

The  dynamic  behavior  of  the  system 
can  be  represented  by  a  consecution  of 
states 


t 

i 

2 

t  t+IL 

y(t) 

?X!(1) 

fx|(2)  ... 

fxj(t)J  ... 

or  by  a  state  transition  matrix,  as 
usually  applied  in  the  description  of 
Markovian  processes.  The  state  trans¬ 
ition  matrix  T  (in  general  2n,2n)  maps 
all  possible  state  descriptions  y(t-l) 
at  state  t-1,  represented  by  the  vector 
y(t-1).  into  all  possible  state  descrip¬ 
tion  y(t)  at  the  next  state  t,  repre¬ 
sented  by  x(t): 

Porschungsgemeinschaft  (F.J.S.)  and  by 
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(3) 


Zn(t)  *  Vn^"*0* 


In  other  words  T_  maps  the  vector  space 
Y  of  into  itself. 

We  call  2jj(t)  an  intensional  vector. 

and  went  to  distinguish  it  from  another 
vector  to  be  introduced  later  as  an 
extensionalor  spectral  vector  (LFJH- 

mxmm — - — 

The  intensional  vector  j  (t)  is 
called  to  be  of  n-th  order  with  n  re¬ 
presenting  {the  number  of  discrete  vari¬ 
ables  of  the  system.  The  elements  of 
the  vector  y_(t)  amount  to  2r  and  can 
be  obtained  by  the  ordered  Cartesian 
product  of  all~x  two-valued  elementary 
vectors.  Omitting  the  state  index  t, 
we  write: 


For  example  no3  yields: 

X1X2X3,X1X2X3,X1X2X3,X1X2X3^  * 

Equation  (3)  can  be  considered  as 
an  overall  transfer  function  cf  the 
system.  In  order  to  obtain  more  in¬ 
sight  into  the  structure  of  the  system 
and  the  ways  of  information  flow,  it 
would  be  desirable  to  have  an  explicit 
solution  for  the  single  discrete  vari¬ 
able  x^(t)  in  the  form: 

xi(t)-f(x1(t-1),x2(t-1)...xn(t-1))  (5) 

This  can  be  achieved  by  three  different 
basis  transformations  in  (3).  In  the 
intensional  vector  y_  the  variables  of 
the  elementary  conjunctions  x!  are 
substituted  (DE  IUCA, HAMMER)  xby  the 
following: 

H- transformation : 

■  V2('1+ri)  a  *  . 

-  1/201-rp  v*  + 

or  in  vectorial  form 

*1  *  (£j)  “  1/2  [l  -l](r.)  •* 
h  -  V2Hi£i  -  Ufa  (6) 

HJJ:  elementary  transformation  matrix 
Ihj:  elementary  Hadamard  matrix 

iv,:  elementary  spectral  Rademacher- 
^  Walsh  vector 

r^:  Rademacher  function  of  i-th  order. 

P-tranef orwatioc : 

xi  ”  Ji  »  ”  1-uA,  A-.  ;  v*  + 


or  in  vectorial  form 

*-(*;)■£  °1C1 

2-1  *  (7) 

P^:  elementary  transformation  matrix 
u^:  elementary  spectral  vector 
S-transformation: 

X^^  -  X±  A*  . 

xi  »  1  e  v*  e 

e  denotes  the  logic  exclusive  OR. 

-■e>-G  :)F) 

*1  *  S1-1  (8) 
8^:  elementary  transformation  matrix 

X/j :  elementary  extensional  Boolean 
”  \ector. 


The  H-  and  P-transformation  maps 
from  a  Boolean  space  into  the  real 
space,  whereas  the  S-tranBf ora  projects 
into  another  Boolean  space,  which  is 
isomorphic  to  a  Galois  field  mod  2 
GF(2). 


The  elements  of  the  transformation 
matrices  of  the  n-th  order  are  obtained 
by  the  n-timos  Kronecker  product  (■)  of 
the  elementary  matrices,  as  the  letters 
are  giver,  over  a  finite  field  (GROBNER): 


*n 


ni 


HA- 1  ■  H'l 


...a  (n-times) 


(9) 


or  in  the  form  of  the  normalized  Hada- 


mard  matrix 

1/2°Hn  -  1/2n"1Hn_1  a  1/2H1 

(1o) 

The  same  holi'r  for  Pn  and  SQ: 

Pa  -  Pn-1  ■  P1 

OD 

En  '  Sn-1  *  S1 

(12) 

In  the  case  of  Hi,H^and  P.,  the 

oper- 

ations  +,  -,and  .  are  used, whereas  in 

the  case  of  s.  the  operations  •  and 
A*,  in  the  finite  field  GF(2)  with  ad¬ 
dition  modulo  2,  with  leO-Oel-1, 

and  0#0«0. 


It  is  easily  shown  that  the  elemen¬ 
tary  matrices  have  the  following  pro¬ 
perties: 

H.  is  orthogonal  under  the  operations 
+  and  .  • 

-  E,  (13) 

withtH}1.  Hjj  «  H1,and  ^  is  the  identi¬ 
ty  matrix. 

P.  is  not  orthogonal,  with  P.  f  Pi** 
and  P^1-  R  °]  we  have 

■  P^1  -  E1  (14) 


S.  is  orthogonal  under  the  operations 
e  and  /v-.  . 


With  s: 


S1  and  (S*)"1 


we  have 


As  the  Kronecker  product  preserves 
the  properties  of  the  elementary  ma¬ 
trices  (GROBRER),  we  have: 

-  En  <16> 

pn1pn  “  “  En  07> 

S„S„  -  E  .  (18) 


Pn1pn 

n  n 


The  elements  of  the  vectors  r^,  uQ, 

i  x  of  n-th  order  we  obtain  also  by 
9  Cartesian  product:  For  example 


CJ- 

h- 


-  -n-1  x  \l  /  ’ 
with  n  ■  3  we  get 

£3  «(‘1.r3»r2,r2r3,r1,r1r3,r1r2tr<1r2r3) 

£3  ■(x'jx2x3tXlx2*x1x3’x1*x2x3,x2*x3*^ 

The  elements  of  the  spectral  vector 
r_  represent  the  Walsh  functions  in 
rae  natural  Walsh-Paloy  order  written 
as  products  of  Pademacher  functions. 
Here  we  replace  the  nonlinear  Rademach- 
ar  products  r1r2r3...rn  by  auxiliary 

variables,  the  Walsh  functions,  in  the 
sense  of  a  Hamilton  transformation. 

This  "linearization"  together  with  the 
intrinsic  properties  of  the  Rademacher 
functions  leads  to  the  advantage  of 
solving  logic  (Boolean)  equations  by 
matrix  operations  despite  the  tinder- 
lying  nonlinearities.  The  same  is  true 
with  Ujj  and  *n. 

For  the  intensional  vector  of 
n-th  order  we  thus  have  the  three 
basis  transformations: 

In  *  <V2nHn£n  (19) 

In  “  prAi 

In  *  sn?n*  (21) 

The  substitution  of  (19),(2o),and(21) 
into  (3)  yields: 

-  1/2nTaHn£a(t-1) 

and  with  (16) 

^(t)  . 

.  (22) 

V  nv,  «» 

and  with  (1?) 


Uq^)  -  BIJun(t-1) 

B_»  Pr^T.P-  and  T„  . 
n  n  n  n  n 


Wn  >  <»> 


-  VA,m) 

and  with  (18) 

4W  -  8nWW) 

“  G^nCt-1) 


C  «  8  T  S  »nil  T 
n  nnn ““  n 


Wn  • 


Thus  we  obtain  among  others  the  ex¬ 
plicit  solutions  for 

JRj(t),  r2(t),...,  rQ(t); 

^(t),  ug(t),...,  u^t); 

*^(t),  x2(t),...,  xn(t); 

which  represent  the  structural  depen¬ 
dency  of  one  variable  at  t  from  the 
variables  at  the  former  state  t-1.  How 
to  reach  the  explicit  solution  in  X, 
given  a  solution  in  R  or  U,is  depicted 
in  the  following  diagram: 


with  Uj,  -  1/2nP“<iHngr  1/2*0^  and 


pi\ 


n 


and  f :  ♦  •  e  . 

The  structural  dependencies  in  X 
tell  us  a  possible  way  of  information 
flow  in  the  system. 

Equations  (23).(25)»  and  (27)  show 
how  to  solve  the  inverse  problem  of 
finding  the  state  transitions  given 
the  structural  relationship  between 
the  variables.  Ag,  BQ  ,  and  Cn  we  call 

the  structure  matrix  of  order  n  of  the 
system. 

So  far  we  have  silently  assumed 
that  the  state  t  is  completely  deter¬ 
mined  by  the  previous  state  t-1.  In 
reality  this  is  seldom  true; the  state  t 
might  as  well  depend  on  earlier  states 
t-d»  d*1*2,3»«..2^-1,  representing  the 
memory  depth  of  the  system.  Under  these 
circumstances  we  write: 

2n(t)*Tn,h(2n(t-1)  x  2n(t“2>  x*** 

•  •  Zn(t-i  )  •  •  •  ) 

•  *.,!*<*•>  <2S> 
with  h  representing  the  order  of  the 
newly  formed  vector  of  the  "previous" 
states.  The  order  h  can  increase  to 
n(2n-1)  maximally.  The  number  of  the 
elements  of  ^(t*)  and  the  rows  of  Tn 

will  then  be  2°  -  2n(2n“1}  and  the 


number  of  the  columns  2°.  The  structur¬ 
al  relationship  between  the  state 
variables  will  be  obtained,  for  example 
by  the  S-tranr,form,by  substituting(21 ) 
into  (28)  and  we  have: 

*»<«  -  Vn.l.W4')  <29> 

Static  systems  can  be  described  by 
the  structural  relationship 

2n  ’  %  (3o) 

in  the  X  domain. 

For  a  system  with  memory  depth  of 
one  state  it  can  easily  be  shown  that 
the  following  holds: 

Jo(t)  -  Tjxn(t-d)  (3D 

with  i  m  1f2,3,...2n-1. 

If  for  some  j«e,  2n(t)-2a(t-e)  ,  or 
T*»Eft  with  the  rank  r  of  TR  and  EQ 

r-211,  we  call  5*  cyclic.  It  has  got  the 
properties  of  a ,  permutation  matrix  and 
(3)  can  be  inverted  to  (CULL): 

j^(t-l)  -  ^"^(t)  (32) 


simplifying  we  can  say  that  the  pitui¬ 
tary  gland, anatomically  and  function¬ 
ally  connected  to  the  hypothalamus, 
produces  two  hormones  as  information 
carriers ,  the  follicle  stimulating  hor¬ 
mone  (FSH)  and  the  luteinizing  hormone 
(LH),  which  stimulate  the  ovaries  with 
respect  to  follicle  growth,  maturation, 
ovulation,  and  steroid  (sex)  hormone 
production. 

The  ovarian  steroid  hormones  com¬ 
prise  two  groups  of  different  biolog¬ 
ical  activities,  the  estrogens  and 
gestagens.  Both  control  the  LH-  and 
FSH-production  and  secretion  in  the 
pituitary  by  a  negative  feedback.  In  a 
certain  state  of  the  system  the  estro¬ 
gens  elicit  also  a  positive  feedback  on 
the  pituitary,  which  causes  the  FSH- 
and  LH-surge  in  the  middle  of  the  cycle 
and  is  followed  by  the  ovulation  and  a 
considerable  increase  of  the  gestagen 
production  by  the  ovary  during  the  sec¬ 
ond  half  of  the  cycle.  Estrogens  and 
gestagens  also  induce  proliferation  and 
secretion  in  the  endometrium.  At  the 
end  of  the  cycle  the  hormonal  decline 
causes  the  menstrual  bleeding. 


Vith  these  properties  the  system  under 
consideration  shows  cyclic  or  periodic 
behavior  with  a  cycle  length  or  period 
of  e. 

In  case  of 

•  *<-Tn+1-Tn+2-  *  * 

we  call  T  transient  with  the  charact¬ 
eristic  exponent  e.  The  system  has  got 
a  transient  length  of  e,  i.e.  starting 
in'  state  t  the  system  reaches  the  limit¬ 
ing  state  t+e  or  the  state  of  eauiffnaF' 
ity  (VOfr  BERTALAU FPY }  after  e  transi¬ 
tions.  We  can  write: 

^(t+e)  -  ^(t), 

or  generally 

2n(t+e+a)»T®+ayn(t)-T^£n(t)  (35) 

with  a«0, 1,2,3 ,...,oo  . 

In  the  limiting  state  t+e  the  system 
has  lost  all  infotmation  of  any  pre¬ 
vious  state.  This  gives  some  plausi¬ 
bility,  why  a  transient  matrix  is  not 
invertible. 

There  also  exist  systems  and  thus 
matrices  that  are  cyclic  and  transient. 
The  cyclic  and  transient  properties  of 
the  state  transition  matrix  T_  are  also 
inherent  in  the  structure  matrices  A_, 
Bn,  and  C  ,  as  the  H-,  P-,  and  S- trans¬ 
formations  preserve  these  properties 
(CROMER). 


Application 

As  an  example  out  of  the  field  of 
biology  and  medicine  we  have  chosen 
the  human  female  reproductive  cycle 
or  menstrual  cycle.  It  evolves  in  time 
with  a  period  of  about  28  days.  In 


mone  levels  in  the  blood  are  depicted 
in  Fig.1.  Further  simplification  and 
abstraction  to  discriminatory  states 
yield  Fig.2a  and  Pig.3t.  Seven  differ 
ent  states  (t-1,2,...7)  can  be  distin¬ 
guished  and  described  by  8  two-valued 
variables  x1,Xo,...,xs  .  The  so  far 
known  structure  of  the  information  flow 
in  the  system  can  be  seen  in  Fig.4. 


in 


Fig.  2a  b 


Ukuftitn  »t  *h»  dyadic  tttli  vtntbh 


Ntrmtl  c ycli  Simulatim 


Fig.  3a  b 

The  problem  to  be  solved  ic  to  find 
a  transfer  function  of  the"black  boxes" 
®1*®2**",*®8*  representing  subsystems, 
which  generate  x^t),  i-1,2,...8out  of 
x^(t-l).  In  general  the  memory  depth 

is  assumed  to  be  one  state,  except  for 
x6>3c7*  an*  x8»  in  which  case  a  memory 

depth  of  2  states  is  necessary  to  ob¬ 
tain  determinancy. 

With  the  mathematical,  technique  dis¬ 
played  in  the  former  chapter  we  obtain 
the  explicit  solutions  or  transfer 
functions  in  the  Rademacher-Walsh  do¬ 
main  by  the  Hadamard  (H-)  transform: 

With  r±(t )-rit  ri(t-1)*r£t  r±(t-2)-r| 

r*-?/I6(1+rp  (1-rp  (1-r4)  (1-rp 

(2(1-rJJ )  (1+rp+(1+rpd-rp  (1-rp)-1 

in 


Fig.  h 

r2-1/26Cl-r£)  (2(1-rjj )  (1-rp  (1-^) 

Cl+r^)  (1-rp+(1+rJ| )  (1-rp  (  (1-rp 
(1+r4)(1+ri)(1+r4)+(1+ri)(1-r4) 
(1-rp  (1-rp  ))-1 

r3»1/24(1-rp  (1-r4)  (1+rp  (1-rp  (1+rp-1 
r4-1/22(1+r4  )  (1+rp  (1-rp-1 
r5«1/2(1-rp(1-rpp-l 
r6-1/25(1+rj; )  (1+rp  (1-rp  (1+rp-l 

r7»1/28(1+rj} )  (1-rp  (1-ri)  (1+r4)  (1+rp 
(1+rp  (1-r^)  (1-rp  (1-rg)-1 

r8-1/25(1-rjj)(1+rp  (1-rp  (1+rp 
(1-rp(1+rp-1 

And  in  the  logic  domain  by  the  S— trans¬ 
form  with  xi(t)-xi,  xi(t-1)-xj, 

xi(t-2)-x|  we  have: 

X1"  *20«*p(1ex4)(1exp(xJjexp1e 
xplexp)) 

Xg-  (lexp  (  (lexp ('I**p(1ex4)xp1exp 
e  x^  (1  exp  (  (1  #xpx4x  ixi  •  xi(1ex4) 
(lexp  (lexp)) 

x3*  x5x7<1*x5></,*x4)(1exp 
x4-  xj|x£  e  x^XgXj 

V  x2  *  x5  •  x2*3  •  X3X5 
x6-  x^x^dexjj) 


x?-  xjjx4xix£(1ex£)(1exp(1ex£) 
(1*x^)(1*xg) 

Xg-  xJpCjxg(1exJp(1ex£)(1ex!p 


Fig.  5 

According  to  the  above  formulas 
circuits  can  be  constructed  that  be¬ 
have  analogously  to  the  quantized  ob¬ 
servables  of  the  menstrual  cycle. 

A  possible  realization  of  the  network 
in  the  logic  S-domain.  with  a  DO  source 
of  unity  (1),  delays  (»)»  and  the  logic 
elements  "exclusive  0R"(+)  and  "AND" 
(.),  is  shown  in  Fig. 5. 

The  effects  of  a  contraceptive  es¬ 
trogen  and  gestagen  medication,  as 
shown  in  the  two  upper  curves  xn  Fig. 

2b  and  the  three  upper  rows  in  Fig. 3b 
can  be  simulated.  The  results  are  seen 
in  the  lower  parts  of  Fig. 2b  and  3b 
and  are  consistent  with  the  biological 
findings  of  a  missing  5SH-  and  LH- 
surge  and  the  omission  of  the  ovula¬ 
tion. 

Conclusion 

The  application  of  this  mathemati¬ 
cal  technique  is  not  limited  to  the 
female  reproductive  cycle,  but  can  be 
applied  to  other  biological  and  medical 
systems  for  the  purpose  of  description, 
simulation,  and  prediction.  It  can 
equally  well  be  used  for  the  design  of 
logic  switching  circuits. 


By  the  H-,  F-,  and  S-transform  the 
intensional  state  description  of  the 
system  in  the  Boolean  domain  is  pro¬ 
jected  into  other  domains, where  matrix 
operations  are  possible  and  explicit 
solutions  can.be  obtained  for  the  dis¬ 
crete  logic  variables.  The  computation¬ 
al  simplicity  is  greatest  in  the  logic 
exclusive-OR  domain  X,  lower  in  the 
Rademacher-Walsh  domain  R,  and  lowest 
in  U. 

In  bur  example  of  a  systems  descrip¬ 
tion  we  have  incorporated  only  perti¬ 
nent  information  in  a  discrete  form. 
Thereby  we  have  circumvented  the  unsur- 
mountable  difficulties  of  a  continuous 
description  in  the  realm  of  biology1 
and  excluded  the  pseudoaccuracies  re¬ 
sulting  from  differential  and  integral 
calculus* 
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Abstract 

Models  of  biological  systems  are  often  based 
on  sampled  data  In  which  the  values  of  variables 
are  associated  with  large  variances.  Under  these 
conditions  it  Is  traditional  to  assume  continu¬ 
ity  In  time  and  amplitude,  so  that  time  Is  con¬ 
tinuous  and  each  amplitude  is  an  element  of  the 
real  line.  An  alternative  approach  Is  to  utilize 
a  discrete  time  scale  with  time  Identified  by 
points  at  which  samples  are  obtained  (sampled 
data  approach)  or  at  which  changes  of  state  oc¬ 
cur  (discrete  event  approach).  Furthermore,  var¬ 
iables  may  be  quantized  to  distinguish  only  that 
number  of  levels  of  a  variable  which  may  be  dis¬ 
tinguished  statistically.  This  results  In  an  or¬ 
dinal  scale  of  measurement.  In  cur  experience  It 
Is  rcre  to  require  more  than  eight  levels  of  an 
experimental  variable,  using  the  above  criterion. 
The  mathematical  handling  of  such  discrete  vari¬ 
ables  may  be  greatly  simplified  by  coding  each 
variable  into  a  Boolean  vector.  This  aporoach 
also  eliminates  certain  problems  of  nonlinear¬ 
ity.  State  variables  which  have  not  been  ob¬ 
served  are  distinguished  In  such  a  representa¬ 
tion  ss  unknown  parameters  which  are  themselves 
Boolean  elements.  These  parameters  can  be  Iden¬ 
tified  by  the  solution  of  simultaneous  Boolean 
equations.  These  equations  arise  by  application 
of  a  constraint  of  functionality  (determinism) 
whereby  a  -Iven  input  applied  at  a  given  state 
must  lead  >.o  a  unique  output.  A  technique  for 
solving  such  equations  has  been  evolved  for  the 
Boolean  algebra  of  n-dlmens tonal  Boolean  vectors, 
conjunction  and  Inclusive  disjunction.  Simpli¬ 
fication  following  parameter  Identification  leads 
to  compact  representations.  The  finite  cardina¬ 
lity  of  thi  models  aids  In  identification  of 
inconsistencies  and  thus  of  critical  sxperiments, 
and  aids  In  the  consideration  cf  the  relative 
validity  of  alternative  structures,  A  simple 
theorem  relates  the  disjunctive  normal  repre¬ 
sentation  of  a  Boolean  sequence,  In  which  the 
elements  are  regarded  as  Integers,  to  the  Wslsh 
Transform,  and  thus  relates  a  logical  formula¬ 
tion  to  an  (arithmetic)  algebraic  one.  Boolean 
mlnterms  can  then  be  identified  by  solution  of 
simultaneous  algebraic  eauations.  The  relation 
Is  of  potantla!  significance  for  applications 
to  large  systems  of  the  variety  described  above. 

Introduction 

Models  of  biological  systems  are  formulated 
to  summarize  complicated  sets  of  data,  to  serve 
as  a  basis  for  simulation  and  thus  for  predic¬ 
tion  of  tbs  outcomes  as-yet-unperformed  experi¬ 
ments,  or  to  Increase  one's  understanding  of  the 
real  system  described  by  the  model.  The  process 
of  modeling  Inevitably  begins  with  the  abstrac¬ 


tion  of  the  real  system  In  order  to  associate 
certain  mathematical  objects  with  elements  of 
the  real  system.  Inevitably,  certain  features 
of  the  real  system  art  emphasized  at  the  ex¬ 
pense  of  others.  The  best  models  are  those 
which  are  Isomorphic  to  the  real  system  with 
respect  to  those  feature'  which  ere  considered 
critical  and  which  have  ;-otiv*ted  the  construc¬ 
tion  of  the  model  1.*  the  first  place.  Several 
properties  of  biological  systems, and  certain 
aspects  of  bto’ogy  as  a  science,  suggest  the 
validity  of  constructing  models  of  biological 
or  medical  systems  which  utlliZv 
quantized  In  both  amplItuH*  and  f  . 

Of  primary  Importance,  .c  maj'  j- 

rary  eroblems  In  such  ar«  as  pin-  "  j1 
control  systems  and  medical  diagnosis  tend  to 
emphasize  aspects  of  the  connectivity  o*  sys¬ 
tems.  The  problem  may  be  stated.  In  a  complex 
svstem  In  which  all  the  elements  ore  Intercon¬ 
nected,  which  connectors  are  of  c-ItTc*!  Im¬ 
portance?  What  Is  the  relative  Importance  of 
the  critical  connections?  If  the  svstem  Is 
malfunctioning.  Is  a  connection  disturbed,  or 
has  the  relative  Importance  of  the  connections 
chanaed?  Alongside  these  auestions,  the  need 
for  precise  measurement  may  be  minimized. 

Furthermore,  biological  systems  tend  to  be 
noisy,  and  measurements  on  them  often  are 
associated  with  large  variances.  As  Chang  (1) 
has  pointed  out,  there  Is  a  natural  quantiza¬ 
tion  associated  with  the  signal/noise  ratio, 
and  with  all  band-limited  signals.  As  variances 
become  high,  the  number  of  levels  into  which  s 
signal  can  be  resolved  becomes  quite  small.  Li 
and  Urauhart  (2)  have  analyzed  the  secretory 
properties  of  the  adrencl  gland  in  this  way, 
and  have  shown  tb<i?  It  can  be  viewed  as  secre¬ 
tory  nst  continuously,  but  at,phly  eight  dif¬ 
ferent  rates.  In  addition  to  large  variances, 
certain  measurements  can  be  made  only  at  dis¬ 
crete  Intervals.  This  Is  always  the' case  for 
samples  of  body  fluIJs  or  tissues  which  must- 
be  submitted  to  biochemical  analysis*,  it  Is 
also  the  case  for  so-called  continuous  measure¬ 
ments  In  which  the  time  constant  of  the  meas¬ 
urement  is  large  with  respect  to  the  dynamic 
properties  cf  *he  system.  The  measurement  of 
cardiac  cutout,  which  Is  based  on  the  dilution 
of  an  tnlected  dve.  In  one  example:  since  the 
phenomenon  of  distribution  must  be  measured 
over  a  period  of  many  heartbeats.  Thus  qusnti-, 
zaf'on  may  be  Implicit  either  In  the  system 
or  in  the  process  of  measurement. 

The  present  oaeer  describes  a.,  technique  for 


the  modeling  of  systems  with  variables  quantized 
In  amplitude  and  time  which  extends  previous 
descriptions  of  this  approach  (3 ,4,5) .  It  Is 
shown  that  the  problem  of  Identification  of 
parameters  In  such  a  model  reduces  to  the  prob¬ 
lem  of  the  solution  of  simultaneous  Boolean 
equations,  and  a  new  method  Is  Introduced  to  ac¬ 
complish  this.  A  relation  of  this  formulation  to 
the  Walsh  transform  Is  examined.  An  extension 
of  the  present  approach  which  was  suqqested  by 
this  examination,  but  which  offers  certain  com¬ 
putational  advantages.  Is  described  In  an  ac¬ 
companying  paper  (6). 

The  Formulation  of  -Boolean  Models 

Given  a  system  to  be  modeled,  tt  Is  first 
necessary  to  abstract  the  system,  to  define  the 
sets  of  Inputs  and  outputs  and  to  formulate  an 
Initial  view  of  the  connectivity  of  the  system. 
The  variables  can  be  quantized  In  amplitude 
accordlnq  to  Chang's  method  (I),  or  In  any  other 
Intuitively  useful  way.  For  example,  the  process 
of  measurement  or  the  design  of  experiments  may 
sugqest  appropr'ste  approaches  to  quantization 
(5,4).  Quantization  In  time  may  be  based  on 
sampling  Intervals  (sampled  data  approach,  des¬ 
cribed  below)  or  on  times  at  which  changes  In 
state  occur  (dtscrete  event  approach  (See  (7)). 
The  differences  between  levels  of  the  amplitude 
variables  need  not  be  equal:  only  linear  order¬ 
ing  Is  required.  The  scale  of  measurement  for 
amplitude  Is  thus  ordinal.  The  amplitude  vari¬ 
ables  are  then  coded  Into  appropriate  Boolean 
vectors.  Any  code  will  suffice.  We  have  In  gene¬ 
ral  used  the  natural  equivalent  to  a  binary  re¬ 
presentation  of  the  ordinal  number.  On  the  other 
hand,  Brand  (18)  has  shown  that  the  Gray  code 
has  certain  advantages  If  there  are  ambiguities 
In  the  quantization.  Since  the  mapping  from  or¬ 
dinal  measure  to  Boolean  vector  Is  one-to-one, 
the  decodlnq  procedure  Is  Implicit.  In  qeneral 
the  model  will  take  the  format  of  a  set  of  In¬ 
terconnected  subsystems.  As  a  result  of  the 
quantization,  there  can  be  only  a  finite  number 
of  Inputs  to  the  system  or  to  any  of  the  sub¬ 
systems.  One  might  be  able,  tf  all  Intermedi¬ 
ate  variables  are  known,  to  write  a  truth  table 
for  each  subsystem  and  for  the  system  as  a  wh¬ 
ole  which  will  list  all  possible  outputs  for 
all  possible  Inputs  and  times  (4).  In  qeneral, 
there  will  be  one  or  more  Intermediate  variables 
which  cannot  be  observed.  This  gives  rise  to  the 
problem  of  Identification:  to  find  the  values 
of  all  unobserved  variables.  This  procedure 
would  be  entirely  arbl  trary"  IT~'we  did  not  want 
to  be  able  to  use  the  model  for  prediction. 
UtMever,  predictability  Implies  determinism, 
which  Introduces  In  turn  the  constraint  of 
functionality:  for  a  given  Input  and  state, 
there  can  be  one  and  only  one  output.  This 
constraint,  applied  to  each  subsystem  Implies 
that  If  In  any  two  rows  of  a  truth  table  the 
Inputs  are  equal,  then  for  these  rows,  the 
outputs  must  also  be  equal  (4).  Thus  for  a 
subsystem  with  Input  rj  and  output  si  one  could 
write 

Vi  -  r2) - >  (Si  -  S2),  (1) 

where  -  ■ )  stands  for  Implication' 
from  the  oxlons  of  Boolean  algebra,  equation  (l) 


becomes 

(rlr2  +T,r2) 

Since  the  statement  a 


(S,S2  +  S,'?2)  (2) 

b  Is  equivalent  to  a+b, 


equation  (2)  can  be  written 
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In  general,  for  a  subsystem  with  multiple  In¬ 
puts  and  outputs,  the  Identification  problem 
will  then  reduce  to  the  problem  of  solving  an 
equation  of  the  form 

Ax  ♦  Bx  -  1_,  (4) 

where  X  Is  an  n-  vector  of  the  n  Inputs  and  out¬ 
puts,  A  and  B  are  Boolean  mxn  matrices  and  ]_ 

Is  an  m-vector  all  elements  of  which  are  1 .~ 

A  method  for  the  solutton  of  this  class  of 
equations  Is  given  below. 

Examples  of  static  (3)  and  discrete  event 
(7)  Boolean  models  have  been  presented  else¬ 
where.  The  static  example  Is  particularly  In¬ 
teresting  In  light  of  the  discussion  above; 
since  It  was  shown  that  the  Initial  structure 
(connectivity)  chosen  for  the  system  did  not 
allow  any  solution  to  the  simultaneous  equations 
for  one  of  the  subsystems.  Accordingly  an  alter¬ 
nate  connectivity  was  selected  which  appeared 
compatible  with  the  experimental  evidence. 
Further  experiments  were  conducted  to  test  the 
new  connectivity,  and  this  was  shown  to  be 
correct  (9).  Thus .application  of  this  modeling 
procedure  led  to  a  novel,  hitherto  unsuspected 
and  Important  physiological  finding  concerning 
a  hormonal  action  on  the  central  nervous  system. 
The  discrete-event  example  Is  Interesting  be¬ 
cause  It  offers  a  Boolean  model  of  a  techno¬ 
logical  process  (In  this  case  a  conveyor  system) 
and  thus  indicates  the  applicability  of  this 
approach  to  non-blologtcal  cases.  Aveyard  (7) 
showed  that  the  discrete  event  approach  was 
dimensionally  smaller  and  thus  simpler  than  an 
equivalent  model  of  the  system  as  an  automaton. 
Nevertheless,  there  are  occasions  In  which  one 
may  prefer  the  automata  approach.  One  such 
circumstance  Is  that  in  which  Inputs  and  outputs 
are  sampled  periodically,  and  one  seeks  a  model 
to  relate  them  in  the  absence  of  knowledge  of 
the  mechanisms  relating  inputs  and  outputs.  An 
example  follows. 

A  Sampled-Data  Dynamic  Boolean  Hodel 

The  adrenal  gland  of  many  mammals  secretes  a 
hormone,  cortisol,  In  response  to  the  presenta¬ 
tion  of  a  hormone  from  the  pituitary  gland,  cor- 
ticotrophln,  or  ACTH.  ACTH  it  released  by  the 
pituitary  In  response  to  a  variety  of  stimuli 
generally  termed  "stress,"  and  cortisol  plays 
a  central  role  in  the  defenses  of  the  body  aga¬ 
inst  hemorrhage,  Injury  and  other  stresses  (10). 
for  reasons  given  elsewhere  (3)  It  seems  desir¬ 
able  to  model  the  overall  system  In  Boolean 
form,  Urquhart  and  LI  (11)  have  described  In  de¬ 
tail  the  dynamics  of  the  adrenal  response  to 
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ACTH,  and  have  offered  a  continuous  model  to 
account  for  these  dynamics.  The  adrenal  dis¬ 
plays  a  static  nonlinearity  so  that  Its  respon¬ 
se  saturates  at  large  Inputs  of  ACTH.  There  is 
also  a  dynamic  asymmetry  such  that  an  over¬ 
shoot  Is  present  In  the  response  to  presenta¬ 
tion  of  ACTH  (at  submsxlmal  levels  only),  but 
there  Is  no  undershoot  In  response  to  with¬ 
drawal  of  ACTH.  All  of  these  properties  can 
be  displayed  If  cortisol  secretion  Is  viewed  In 
four  levels  (2  bits),  though  the  gland  Itself 
actually  behaves  as  If  It  operates  In  eight 
levels  (3  bits)  (2).  We  offer  here  this  simpli¬ 
fied  model  of  the  adrenal  response  to  ACTH, 
based  on  a  2-blt  processor,  as  an  Illustration 
of  a  sampled-data  dynamic  Boolean  model. 

The  (sampled)  output  of  secretion  of  cor¬ 
tisol  In  response  to  presentation  of  ACTH  as 
a  unit  pulse  rnd  ns  pulses  of  three  different 
amplitudes  and  longer  duration  Is  shown,  after 
quantization,  In  Flqure  1.  The  overshoot  and 
saturation  are  evident.  For. convenience  the 
differences  between  levels  of  the  output  vari¬ 
able  F  have  been  drawn  as  equal.  In  fact  the 
distance  from  r  ■  10  to  F  *  II  should  be  short¬ 
er  than  that  from  F  ■  01  to  F  »  10. 


Identification  procedure  outlined  above.  The 
overall  dvnamlc  model  for  the  system  as  two 
8oolean  enuatlons  Is  relatively  compact,  yet 
describes  In  full  thf  complexity  of  the  data 
of  Flqure  1.  Furthermore,  the  model  Is  com¬ 
plete:  simulation  will  atve  an  output  for 
any  waveform  of  Input,  restricted  to  frequen¬ 
cies  at  or  below  the  samoltnq  rate.  The  over¬ 
all  equations  are  for  output  at  time 

k+>.  Vi  -<f',  fi)- 

f>,  m  ?lz2*3*4J5  +  *1*2*5  (*3+zI,) 

+  (z5  +  zg) 

f  1/2  -  z]z2z3z4(3?5  +  z6)+  ziz253zA 

+  *1*2  <z3r4*5  + 
^3*4*6  +  z3z5z6> 


The  overall  model  of  the  adrenal  can  be  re¬ 
presented  as  a  finite  automation,  as  In  Fig¬ 
ure  2.  A  Is  a  delay  of  one  ttme-untt. 


A  truth  table  was  constructed  to  relate  a 
state  vector  £  to  the  two  past  outputs,  each  of 
which  Is  a  2-vector,  to  the  next  output,  and 
to  the  past  Input.  The  constraint  of  functiona¬ 
lity  was  applied  to  define  the  state  elements, 
as  Indicated  above.  For  a  six-component  state 
vector  Z,  for  the  output  at  time  k,  ^  -  (f  j , 
f2)  and  the  output  at  time  k-l,  ft.]-  (f3  f ^ J 
and  for  the  Inpur  at  time  k>a|<  «  (aj,a2),’the 
state  equations  are  simply:  ' 

z,  -  f2f3fi, 

z2  -  fl  +  f2  z5  -  a, 


*4  *  h 

A  truth  table  was  next  constructed  for  the 
overall  system  relatfnq  the  Inputs  and  present 
state  to  the  present  output.  The  mlsslnn  ele¬ 
ments  of  the  truth  table  were  derived  from  the 


Solution  of  Simultaneous  Boolean  Equations 

The  solution  of  Boolean  equations  seems 
deceptively  simple.  In  fact,  many  techniques 
are  available  and  are  effective  provided  that 
the  number  of  variables  Is  very  small.  Host 
■techniques  depend  upon  enumeration  of  the 

2N  possible  values  of  N  boolean  variables 
and  hence  are  directly  or  Indirectly  techni¬ 
ques  for  solution  based  on  exhaustive  search. 
Such  methods  are  completely  Ineffective  when 
the  number  of  variables  becomes  reasonable 
(qreater  than  20) .  The  objective  of  thls.sec- 
tic~  Is  to  describe  the  technique  which  lias 
been  developed  and  Implemented  for  the  solu¬ 
tion  of  Boolean  equations  which  a-lse  In  the 
applications  described  In  the  previous  sections. 
Two  criteria  are  evident:  first,  the  form  of 
the  boolean  equations  and  the  technique  used 
for  their  solution  must  be  emonable  to  digi¬ 
tal  computer  implementation:  and  second,  the 
solution  technique  must  not  be  equivalent  to 
enumeration  of  all  possible  values  of  the 
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variables. 


The  efficient  representation  of  the  equations 
in  computer  memory  leads  to  the  linear-like  form 
shown: 


A  X  +  B  J  -  I 


(5) 


Here,  as  before,  X^  Is  an  N-vector  of  the  N 
boolean  variables,  A  ana  B  are  H  x  N  matrices 
all  of  whose  elements  are  0  or  1 ,  ]_  is  an  M- 
vector  all  of  whose  elements  are  l,  and  matrix 
multiplication  is  implied  in  the  usual  sense 
except  that  multiolication  is  replaced  by  logi¬ 
cal  "and"  and  addition  by  logical  inclusive 
"or".  Thus  the  first  of  the  M  equation*  is 
simply 


Jllxl 


+  a 


12x2 


+  a,NxN  +  ]X, 


bINxN 


In  the  above  equation,  either  a | j  or  b.j 


zere:  for  otherwise  the  eauation  is  redundant, 
since  xj  +  Xj  is  identically  1.  Notice  that  the 

storage  of  such  linear-like  eouations  in  me¬ 
mory  is  straightforward,  requiring  one  bit  per 


variable  for  the  storage  of  a; j  and  one  bit  for 


b;j.  It  is  convenient  In  the  solution  to  groun 

L  coefficients  in  each  computer  word  (where  L 
is  the  word  length  of  rhe  computer)  to  mini¬ 
mize  storaqe  and  to  take  ad/antage  of  whole 
word  log’cal  operations  available  in  most 
digital  computers.  Hence  in  a  36-bit  machine 
and  a  set  of  50  variables  (say),  two  words  are 
used  for  the  storaqe  of  a  row  of  the  A-matrix, 
and  another  two  words  for  the  storage  of  the 
corresponding  row  of  the  B-matrix  with  22  bits 
unused  in  each  group  of  two  words.  The  unused 
storage  is  less  important  when  the  number  of 
variables  is  large  and  is  more  than  made  up  for 
by  the  simplicity  of  logical  operations  that  re¬ 
sult. 


It  is  important  to  note  that  the  form  of 
simultaneous  linear-like  equations  is  complete¬ 
ly  general : 


Theorem  I :  Any  set  of  boolean  equations  in¬ 


volving  N  variables  x.x^,  . 


XN  may  be  ex¬ 
pressed  in  the  form  of  Equation  (5). 

The  proof  of  this  theorem  follows  immediately 
from  the  well  known  result  that  any  set  of 
simultaneous  boolean  equations  can  be  written 
in  the  form  f(x)  =0  where  the  function  f  () 


involves  the  xjs  and  their  negations.  Moreover, 


any  boolean  function  in  M  variables  can  be 
expanded  into  the  standard  min-term  form 
2N 


f (x)  =  ,£.  c.m, (x)  =  0 


where  m.  (x)  is  the  i-th  minterm  and  cj  is  zere 
or  I . 


In  the  above  .xpansion,  the  symbol  "+"  corres¬ 
ponds  to  logical  inclusive  "er".  Since  the 
logical  sum  Is  zere,  each  term  must  be  zere 
with  the  result  that  the  equation  can  be  writ¬ 
ten  in  the  form 


(m. 


0  |c}  -  1,  i  =  1,2 . 2N) 


That  is,  any  ci  which  is  zero  causes  the  term 
to  be  identically  zero.  All  terms  for  which 
c,  «  1  then  require  that  the  corresponding 
mln-term  be  zero.  Notinq  that  each  minterm  is 
the  logical  product  of  the  X|  or  their  nega¬ 
tions,  it  follows  Immediately  that  negating 
eacn  simultaneous  equation  produces  the  logi¬ 
cal  sum  of  variables  or  their  neqations,  which 
is  the  desired  form.  Hence,  any  arbitrary 
Boolean  equations  can  be  expressed  In  the 
linear-like  form  which  proves  convenient  for 
automatic  solution  on  a  digital  computer. 

As  an  example,  consider  the  problem 


t(x)  =  XjXjXj  +  xjj^xj  +  x|X2xj  *  0 
This  function  becomes 


x  IX2X3 
X1X2X3 
7,x2x3 


Negating  each  equation  yields 


0  0  1 
0  1  0 

x+ 

1  1  0 

1  0  1 

X- 

1 

1 

1  0  0 

Lo  1  ij 

1 

(5). 


which  is  the  form  of  Eq. 

It  should  not  be  inferred  from  the  above  proof 
that  this  is  the  easiest  or  most  efficient 
way  to  generate  the  linear-like  Boolean 
equations;  for  in  fact  expanding  in  min-terms 
results  in  many  extra  equations,  since  often 
terms  can  be  combined  and  simplified.  None¬ 
theless,  this  form  does  lead  to  the  solution 
algorithm  discussed  in  the  next  section. 


Solution  of  Simultaneous  Boolean  Equations 
by  Successive  Elimination  o^  Variables 


I n  order  to  satisfy  the  second  criterion, 
and  to  avoid  enumeration  of  the  large  number 
of  combinations  cf  values  of  the  Boolean  vari¬ 
ables,  a  successive  elimination  scheme  is 
developed.  That  is,  one  variable  at  a  time 
is  chosen  to  be  eliminated,  resulting  in  a 
new  set  of  equations  In  the  identical  form  but 
with  one  fewer  variable,  if  this  is  carried 
out  until  only  one  variable  remains,  the  solu¬ 
tion  for  that  variable  is  trivial.  Back  sub¬ 
stitution  then  permits  the  dete-mination  of 
all  other  variables.  In  the  casp  of  multiple 
solutions,  it  is  possible  to  generate  only 
one  solution  at  a  time. 


The  successive  elimination  algorithm  proceeds 
as  follows. 


(step  1) 


Pick  the  variable  to  be  eliminated 
(called  Xj  ir.  this  algorithm).  Let 
the  vector  of  remaining  variables 
be  called  Z.  Write  the  equations  in 
the  form 


a  Xj 


+  b  x,  +  A,Z  +  B,Z 


Here  £  and  b_  are  the  first  columns 
of  the  matrices  A  and  B,  and  Aj  and 
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Bj  are  the  remaining  columns  of  A  and 
B.  This  rewriting  is  simply  for  nota* 
tionai  convenience. 

Denote  the  i-th  equation  by 

(step  2)  ajXj  +  b j x j  +  A](i)Z  +  B|(i)Z  »  i 

Each  equation  for  which  ai  -  bj  »  0 
does  not  involve  X]  and  hence  is  added 
to  the  reduced  set  and  eliminated  from 
the  above  set.  Note  that  any  equation 
for  which  a|  -  bi  -  t  can  be  eliminated 
as  redundant. 

(step  3) 

Each  of  the  remaining  equations  has 
either  a;  or  b;  zero  but  not  both. 

For  each  pair  of  equations  which  have 
a|  ”  bj  *  0,  form  a  new  equation 

Ja(I)  +  A  (jTj  z  +  js(i)  +8(j)j'7  "1 

and  add  it  to  the  reduced  set.  Note 
that  if  there  are  M  equations  with  Mj 
having  ai  =  i  and  (M-M i )  with  a;  “0, 
that  M] (  M-M])  equations  results.  This 
completes  the  reduced  set,  X|  havinq 
been  eliminated.  The  reduced  set  has 
the  same  solution  for  Z  as  the  or'q!- 
nal  set. 

(step  k) 

Co  to  step  1  unless  1  variable  remains 
in  the  reduced  set.  In  this  case,  go 
to  seep  5.  If  there  are  no  equations 
in  the  reduced  set,  go  to  step  7. 

(step  5) 

The  reduced  set  has  only  one  equation 
which  must  be  of  the  form 

a  XJ  +  b  *J  ”  1 

If  a  >*  b  =  0,  no  solution  exists,  if 
a  =  b  ->  1,  x,  is  arbitrary.  To  gene¬ 
rate  one  solution,  pick  a  value  for 
Xj  (  0  or  1)  and  proceed  to  step  6. 

If  a  =  1  and  b  =  0,  x.  “  1.  If  a  »  0 
-one'  b  «  1 ,  x j  =  0 .  J 

In  either  of  the  last  two  cases,  pro¬ 
ceed  to  step  6  after  determining  x j . 

(step  6) 

If  all  N  variables  are  determined, hal t. 
Otherwise,  recover  the  previous  set  of 
equations  which  involves  one  more  vari¬ 
able  than  the  set  used  in  step  5.  Sub¬ 
stitute  the  values  of  the  known  vari¬ 
ables.  The  resulting  equations  have 
only  one  known  variable.  Proceed  to 
step  5. 

(step  7) 

This  step  is  reached  only  if  the  algo¬ 
rithm  results  in  no  equations  In  the  re¬ 
duced  set.  This  implies  that  all  vari¬ 
ables  which  have  not  been  eliminated 
are  arbitrary.  In  order  to  generate  one 
solution,  pick  any  value  for  these  and 
proceed  to  step  6. 

The  above  algorithm  is  guaranteed  to  deter¬ 
mine  one  solution  if  at  least  one  solution 


to  tne  simultaneous  equations  exists.  Notice 
that  it  proceeds  by  generating  new  sets  of 
equations,  each  set  in  the  sequence  having 
one  less  variable  until  one  or  more  variables 
can  be  determined.  Then  the  sets  (which  must 
be  saved)  are  recovered  in  inverse  order,  the 
known  variables  substituted  in  order  to  deter¬ 
mine  the  remaining  ones.  Notice  the  analogy 
to  ordinary  Gauss  elimination  in  the  case  of 
linear  atqebraic  equations. 

In  order  to  demonstrate  that  the  algorithm  Is 
correct,  and  that  no  extraneous  so'utions  ate 
generated  or  legitimate  solutions  lost,  It  is 
necessary  merely  to  demonstrate  the  correct¬ 
ness  of  step  3,  the  other  steps  being  obvious. 
To  this  end,  group  the  equations  so  that  all 
those  with  just  xj  appear  first: 

yt  +  si  -  1  i  *  l.2 . P 

The  remainder  involve  "x) : 

x,  +  Sj  =  1  j  -  .1,2 . q 

where  sj  and  sj  are  the  remainder  of  the 
equation. 

These  can  be  written  in  alternate  form  by 
negating  each  equation: 

x,T,  =0  i  “  1,2, - p 

X]Sj  «  0  1-1,2, . . 

Each  qroup  may  be  combined  into  a  scalat 
equation: 

Ij 

X,  £  S;  -  0 

‘  i  =  l 

x,  £  -s'j  =  o 

Consider  the  truth  table  corresponding  to  the 
following  two  scalar  equations: 

xj  A  »  0 

x,  B  -  0 


AI 

2J 

Solution 

I 

a 

1  - 

0 

i 

1 

I 

G 

1 

71 

1 

lo 

Clearly  a  necessary  and  sufficient  condition 
for  a  solution  for  X]  Is  that  A  B  -  0. 
Applyinq  this  result  to  the  above  scalar 
equations  yields 

£  s.  £  s'  “0 

i  1  J 

fombinlnq'the  summations  changes  the  form  to 
£  s,  sj  »  0 

•J 

Now  negate  the  entire  equation  to 'get  the 
alternate  form 


1SB 


S;  +  S' 

'  J 


In  order  for  the  logical  product  of  quantities 
to  be  1,  each  must  be  I.  Hence  this  reduces  to 
ths  set  of  simultaneous  equations 

Si  ^  s'  -1  1-1,2, .. .p,  J=l,2,...q 

which  is  exactly  the  set  of  reduced  equations 
specified  in  step  3. 

The  remaining  steps  need  no  formal  proof.  Thus 
this  algorithm  produces  a  reduced  set  of  equa¬ 
tions  which  have  the  same  solution  set  as  the 
original  equations. 

An  example  of  this  scheme  is  in  order  before 
its  advantages  and  disadvantages  are  discussed. 
Consider  the  following  equations 


*2  +  x3  =*  1 

First,  eliminate  Xj .  Note  that  tho  last  eq¬ 
uation  does  not  *nvolve  X]  and  only  one  equa¬ 
tion,  the  fourth,  involves  X| .  Hence  the  re¬ 
duced  set  is  formed  by  forming  the  logical 
sum  of  the  fourth  equation  with  each  of  the 
first  three  tc  get  the  first  reduced  set: 

*2  +  *3  "  1 


Note  in  this  set  that  the  third  equation  is 
trivial  and  can  be  deleted.  Next  eliminate 
the  variable  x--  All  three  equations  Involve 
either  Xj  or  Its  negation.  Two  Involve  the 
negation  and  one  X2  itself.  Hence  the  second 
reduced  set  is  the  logical  sum  of  the  first 
and  second  and  the  first  an-s  fourth  equations 
to  yield: 


*3  +  X3 


Of  these  two,  the  second  is  trivial.  The  first 
yields  the  value  Xj  »  1  as  the  only  solution. 
Substituting  Into  the  second  reduced  set  yields 
X2  ■  1  as  the  only  solution.  Finally  substitu¬ 
ting  into  the  first  set  gives  x.  «  0.  Hence 
the  uniqje  solution  is  (0,1,1)  which  may  be 
verified  by  exhaustion  in  this  simple  example. 

Elimination  of  Redundant  Equations 

It  was  observed  in  the  example  above  that 
the  reduction  process  could  produce  redundant 
equations.  This  will  not  affect  the  solution 
but  plays  havoc  with  computer  memoty.  In  that 
extra  equations  can  generate  many  redundant 
equations  at  each  stage  of  reduction  since 


each  equation  Is  logically  summed  with  many 
others.  In  practice  this  is  intolerable,  not 
only  because  of  the  extra  computing  time  in¬ 
volved,  but  more  Importantly  because  of  the 
extra  computer  main  memory  needed  to  store 
the  equations.  It  is  necessary  to  eliminate 
redundant  equations  at  each  stage.  This  may 
be  done  with  the  aid  of  the  following. 

Definition:  Equation  a»x  +  bjx  »  1  is  said 
to  imply  the  equation  a2X  +  b2X  *  1  if  each 
element  of  a^  implies  each  element  of  a2  and 
each  element  of  bj  implies  each  element  of  b2. 
This  is  equivalent  to  saying  that  if  xj  appe¬ 
ars  In  the  first  equation  it  appears  In  the 
second  rquation  and  similarly  for  .  Terms 
may  appear  in  the  second  equation  which  are 
not  in  the  first  equation  however. 

Theorem  2:  Any  equation  which  is  implied 
any  other  equation  Is  redundant  and  may  be 
deleted  without  affecting  the  solution  to 
the  set  of  simultaneous  equations.  This 
follows  immediately  by  wrlti  sq  one  equation 
as  A  »  1  and  the  ejation  which  Is  implied 
by  this  one  as  A+B  «  ..  This  is  possible 
since  every  term  in  the  first  equation  must 
be  present  in  the  second  equation.  Clearly 
if  the  first  equation  Is  satisfied,  no  con¬ 
straint  is  added  Ly  the  second  for  it  is  satis¬ 
fied  for  all  8,  Hence  it  is  redundant. 

A  more  powerful  reduction  is  provided  by 

Theorem  3:  Consider  two  equations  x  +  A  «  1 
and  x  +  B  •  1.  If  A  implies  B  then  these 
two  equations  are  equivalent  to 

B  -  1 
x  +  A  »  1 

The  proof  follows  from  the  consideration  that 
x  +  A-  IT+B  -  1  has  a  solution  only  if  A+B  - 
1.  Since  A  implies  B,  it  follcws  that  A+B  «•  l 
is  equivalent  to  B  -  1.  This  is  evident  from 
examination  of  the  truth  table  for  A  end  B 
adding  the  two  conditions,  A  !mplles_B  and  A 
+B  »  1 .  Hence  the  second  equation,  x  +  B  » 

I  reduces  to  B  »  1  end  the  first  equation  is 
unchanqed.  This  compl'  tvs  the  proof. 

Note  that  the  effect  of  this  ^theorem  is  to 
delete  an  equation  involving  IT.  This  means 
in  the  reduction,  that  equation  passes  im¬ 
mediately  to  the  reduced  set  without  being 
added  logically  to  others  and  decreases  signi¬ 
ficantly  the  number  of  equations  produced. 

The  reduction  procedure  Is  now  modified  as 
fol lows: 

1.  Add  to  step  3:  Cheek  each  new  equation 
to  determine  If  It  contains  both  3 
variable  and  its  negation.  If  so,  delete 
It. 

2.  Add  to  step  1:  Check  each  equation  against 
the  others  using  Theorems  2  and  3  to 
eliminate  redundant  equations. 

With  these  changes,  the  number  of  equations 
generated  Is  minimum  and  the  solution  easily 
generated.  It  should  be  noted  that  If  the 
number  of  equations  Is  large.  It  can  be  time 
consuming  to  compare  each  equations  with  all 
others  to  check  for  redundancy.  However,  the 
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computer  Imp lumen tat I or  can  be  simplified 
greatly  by  defining  the  difference  between  two 
equations  to  be  the  number  of  variables  trfiich 
appear  negated  in  the  one  equation  but  not  the 
other.  That  is  if  X|  appears  in  one  equation 
and  x|  in  the  other,  this  contributes  to  the 
value  of  the  difference.  If  X|  appears  In  both 
or  only  in  one  equation,  it  does  not  contri¬ 
bute  to  the  difference.  Then  note  that  two 
equations  can  satisfy  theorem  2  only  if  their 
difference  Is  zero  whereas  they  can  satisfy 
theorem  3  only  if  their  difference  is  2.  Add¬ 
ing  a  list  structure  to  the  implementation  In 
memory  permits  the  programs  to  keep  track  of 
which  equations  differ  from  others  by  0  or  i, 
and  unly  these  need  be  checked  to  eliminate 
redundancy.  This  greatly  decreases  the  com¬ 
puter  time  required  for  solution. 

Relation  of  Boolean  Functions  to  Welsh 
functions 

The  Walsh  Functions  are  related  to  Boolean 
expressions  through  the  disjunctive  normal 
form.  The  fundamental  theorem  of  Boolean  alge¬ 
bra  states  that  any  Boolean  expression  can  be 
expressed  in  this  form.  Thus  for  any  Boolean 
expression  f,  one  can  write 

f  -  E  b  (rai) » 

where  E~  indicates  the  Boolean  sum  (tnduslve 
disjunction)  and  mt  is  an  individual  minterm. 
One  can  then  form  a  truth  table  for  the  set 
of  minterms.  If  one  then  Walsh  transforms  each 
minterm  column  and  the  column  for  the  original 
function  f,  one  finds  that 

W(f)  E.  [W(mi)] , 

r 

where  W(x)  Is  the  Walsh  transform  of  x  and 
Ea  indicates  the  arithmetic  sum. 

For  example,  consider  the  Boolean  expression 
y  -  xjx2  +  x,  *JT2 

The  truth  table  representing  this  function 
would  be 

y  Xj  x2  x,x2  xjxl, 

0  0  0  0  0 

10  1  1  0 

110  0  1 

0  110  0 

Taking  the  Walsh  transform  of  the  appropriate 
columns  as  indicated  above  yields 

W(x,x2)  -  1/4  (1  -  1, 1,-1) 

W(x,r2)  -  1/4  (1,1, 1,1) 

W(y)  -  1/4  (2, 0,2,0)  »  W  (x,x2)  +  W(xjx^) 

-  Z  .  (W(ml)] 

I  * 

Conversely,  one  can  reduce  a  Boolean  truth 
table  to  the  disjunctive  normal  form  In  an 
equivalent  way.  This  reduction  is  equivalent 
to  solving  the  equation 

f  -  Ep  (c,m}) 


It  not. 

For  example,  given  the  truth  table 


xi 

0 

0 

1 

I 


x2 

0 

i 

0 

1 


one  can  write  the  table  with  mtnterms  as 


f 

1  I 
0  0 
0  0 
1  0 


*1X2 

0 

t 

6 

o 


x,x2 

0 

0 

1 

0 


x,x2 

0 

0 

0 

1 


The  Walsh  transforms  of  the  columns  are  found 
usirq  the  Hadamard  matrix 


H22 


♦  +  + 

-  +  - 

+  -  - 

-  -  + 


and  are 


w(xpr2) 

-  1/4 

(1,1, 1,1) 

W(xjx2) 

-  1/4 

(l.-M.-D 

W(xjxJ) 

-  1/4 

(l.l.-l.-l) 

w(xjx2) 

-  1/4 

(1,-1, -1,1) 

and 

W(f)  - 

1/4  (2,0,0, 2) 

One  can  then 

wrl  te 

the  linear 

1111 

'Cl' 

2 

1-1  1  -1 

c2 

0 

1  1-1-1 

c3 

o 

I  -1  -1  1 

c*. 

2 

Since  the  matrix  is  orthogonal  one  can  write 
immediately 


cf 

’l 

1  1 

1 

V 

T 

c2 

-1/4 

-1 

1  -1 

1 

0 

- 

0 

c3 

-1 

-1  I 

1 

0 

0 

CK 

J 

-1  -1 

1 

,2 

,i 

Thus  ejand  c^  are  «  1,  and  c2  and  Cj  are  -  0, 
and 

f  «  xpTj  +  xj  x2 

This  result  was  self-evident  in  the  simple 
example  but  provides  a  simple  basis  for  the 
computer  implementation  of  expansion  In  -mln- 
terrns  of  large  truth  tables  by  solution  of 
linear  arithmetic  algebraic  equations. 

Tne  relation  indicated  above  Is  entirely  gene 
ral.  It  may  be  stated  as  the  theorem 


{  W(f)  -  E*  (c,W(mj)  )  }«-*{c, 


V 


for  the  values  of  the  coefficients  Cj,  which  The  proof  is  straightforward 

will  be  I  If  m|  is  an  element  of  f  and  o  is 
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W(f)  ■  l/2n  Hn  (ff),  where  Hn  ts  the 
Hadamard  matrix. 

The  matrix  of  rot n terms  H  ts  merely  the  Identity 
matrix 

Therefore  HnM  »  Hn 

Accordingly  there  will  be  a  vector  £  such 
that  ~ 

l/2n  H  (c)  -  l/2n  H  (f)  Iff  c  -  l 
that  Is  cj  •  fj. 

We  hoped  Initially  that  this  relation  would 
provide  a  means  of  rapid  solution  of  the  Identi¬ 
fication  problem  by  permitting  a  transformation 
from  simultaneous  Boolean  equations  to  simulta¬ 
neous  algebraic  equations,  and  thus  permit 
solution  of  n  equations  without  the  expansion 
to  2n.  However,  this  proved  to  be  a  false  hope 
because  the  algebraic  equations  are  In  qenera) 
not  linear.  Accordingly  the  Walsh  transform  per 
se  does  not  appear  particularly  useful  In  thJT'- 
manipulation  of  Boolean  models.  However,  In  the 
course  of  this  exploration.  It  was  found  that 
a  related  orthogonal  transform  Is  particularly 
useful.  Its  properties  and  some  applications 
are  described  in  the  accompanying  paper  (6). 
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MOCELLIMG  THE  COMPOUND  ACTION  POTENTIAL  OF  TTO  NERVE 


C.  BScmtttr 

Battelle-Institut  e.V. ,  Frankfurt/M.,  Giratny 


Abstract 


In  tha  paper  tba  paripharal  nerve  ia 
conaidared  from  a  communications  point 
of  view  as  a  special  transmission 
systaa  bavins  disparsion-lika  propar¬ 
ties.  Tba  natbanatical  nodal  of  tba 
narva  trunk  turns  out  to  bo  a  trans¬ 
versal  filter  with  non-unifora  distri¬ 
bution  of  tba  delay  elanants.  It  is 
shown  that  tha  input-output  relation- 
sbip  of  this  special  filter  sty  be 
described  in  tans  of  discrete  cross- 
correlation  rather  than  of  discrete 
convolution.  Tha  correlation  matrix  of 
tha  narva  is  derived.  The  discrete 
impulse  response  of  tha  systaa  is  shown 
to  consist  mainly  of  the  fiber  diameter 
histogram  of  tha  narva.  It  follows  that 
under  the  condition  of  non-overlapping 
unit  discharge  waveforms compund  ac¬ 
tion  potential  and  discrete  impulse 
response  become  identical.  Thus,  at 
least  in  theory  tha  fiber  diameter 
histogram  of  a  nerve  usually  deter¬ 
mined  by  tedious  electron-microscopic 
procedures  may  be  measured  electroni¬ 
cally.  The  discrete  model  of  the  nerve 
may  be  used  to  compute  the  waveform  of 
the  compound  action  potential  for  ar¬ 
bitrary  unit  discharge  waveforms,  con¬ 
duction  distances  and  nerve  types.  The 
early  graphical  point-by-point  proce¬ 
dure  for  reconstruction  of  the  action 
potential  is  thereby  replaced  by  a 
matrix  algorithm  well  suited  to  be 
adapted  to  computer  programming. 

1.  Introduction 

Mammalian  peripheral  nerves  consist  of 
thousands  of  isolated  individual  fibers 
with  different  diameters  and  different 
conduction  velocities.  Thus,  in  gene¬ 
ral  the  actually  recorded  action. poten¬ 
tials  are  compound,  that  means  they 
contain  the  activities  of  a  lot  of 
individual  neurons.  Consequently  it  is 
difficult  to  separate  the  composite 
waveforms  into  a  number  of  independent 
neuronal  signal  components.  However, 
this  has  to  be  done  before  proatheses 
or  other  external  devices  controlled 
by  neuronal  information  may  be  devel¬ 
oped.  In  £53  an  excellent  review  of  all 
techniques  currently  being  used  is 
given.  However,  practically  all  methods 
are  based  on  the  severe  restriction  of 
non-overlapping  unit  discharge  wave- 
forms.  As  we  shall  see  this  condition 
is  hot  net  in  most  cases. 


Vhat  we  are  looking  for  is  the  mathe¬ 
matical  model  of  the  nerve  trunk  as  a 
transmission  system  based  on  the  known 
physiological  facts  [%D  thereby  repla¬ 
cing  the  early  graphical  reconstruction 
technique  [l] L2J  [3l  by  analytical  com¬ 
putation. 


fig.  1  shows  simplified  a  peripheral 
nerve  containing  many  isolated  indivi¬ 
dual  fibers.  At  t  •  o  a  stimulation 
pulse  is  given.  The  amplitude  is  such 
that  all  fibers  are  innervated  at  once. 


Fig.  1  a)  Basic  measurement  scheme 

b)  Equivalent  transmission  systse 

Each  fiber  responds  with  the  typical 
unit  discharge  waveform  s(t)  travel¬ 
ling  over  the  fiber  with  a  velocity 
determined  by  the  fiber  diameter  (and 
the  nerve  type).  At  x  the  compound 
action  potential  S(x,t)  is  recorded. 

The  unit  discharge  waveform  ef  all 
fibers  has  the  same  shape,  but  not  the 
same  amplitude.  It  depends  on  ths 
fiber  diameter,  too.  The  model  of  the 
nerve  as  transmission  system  is  a  lin¬ 
ear  system  which  may  be  de'sbribed  is 
the  time  domain  by  his  impulse  response 
h(t).  Evidently,  the  conduction  dis- 
tsnce  will  influence  strongly  the  para¬ 
meters  of  the  system.  These  parameters 
and  the  input-output  relationship,  of 
the  system  are  to  be  determined. 


All  fibers  of  the  gross  nerve  are 
grouped  according  to  their  diameters 
falling  into  the  discrete  classes 
having  the  mean  diameter  D^.  This 
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classification  schsais  is  used  by  histo¬ 
logists  to  cbaractsriss  a  nerve  by  his 
fiber  diameter  histogram  obtained  by 
electron  microscopic  procedure.  The 
histogram  may  be  a  function  of  the 
space  variable  x.  However,  little  is 
known  about  this  effect.  Thus,  at  a 
first  approximation  it  is  neglected. 

Fig.  2  shows  the  typical  shape  of  a 
fiber  diameter  histogram.  is  the 
number  of  fibers  falling  into  the  i-th 
diameter  class.  The  mean  diameter  of 
the  i-th  class  is  •  i  •  A  with  i«i<n 
where  A  denotes  the  width  of  the  classes. 


Fig.  2  Typical  fiber  diameter  histogram 

The  unit  discharge  pulses  of  all  fibers 
withir  a  specific  class  can  be  rep re¬ 
sente  i  by  one  spike  whose  amplitude  is 
proportional  to  the  diameter  of  the 
c'sss.  The  delay  of  thie  spike  is  t±. 
T;. .  conduction  velocity  of  the  fibers 
of  the  i-th  class  is  VjmkgD^.  This 
linear  relationship  is  true  in  a  wide 
range  of  diameters.  The  delay  t^  is 

t .  »x/ v .  =>x/k  •  D  »x/k  •  i  *A  «x/ v  -  i=t  / i  (l ) 
i  1  o  i  o  o  1 

with  the  upper  limit  of  the  delay 

t1*x/k<J*A«x/v0  (2) 

Thus,  the  influence  of  all  fibers  of 
the  i-th  class  on  the  compound  action 
potential  is  given  by 

si(t)«i.Ni*s(t-  tj/i)  (3) 

where  s(t)  denotes  the  actual  unit 
discharge  waveform  of  a  fiber.  The 
compound  action  potential  is  given  by 
the  superposition  of  all  n  signals 
representing  the  n  diameter  classes 

.(«.£  i-H^aU-  t4/i)  (4) 

i-1 

Considering  this  equation  some  general 
statements  on  the  output  signal  S(t) 
can  be  made  (Fig.  3).  If  the  fiber 
discharge  signal  has  the  finite  length 
T  the  output  waveform  begins  at  t«ta 
and  ends  at  tmti+T.  Thus  the  output 
signal  of  Equ.  (4)  is  time  limited,  too, 
and  has  the  duration 

Ts-T+tjU-  l/n)  (5> 


Fig.  3  a)  Unit  discharge  waveform 

b)  Compound  action  potential 
waveform 

The  time  delay  is  tn>tj/n.  Full  reso¬ 
lution  occurs  if  the  n'-th  and  (n-l)-th 
waveform  don't  overlap.  Since  the  time 
difference  is  tn_i-tn»ti-n(n-l)  we 
have  the  condition  of  non-overlapping 
ti*T.n(n-l).  Using  Equ.  (l)  this 
becomes 

x*k  •A.T.n(n-l)  (6) 

o 

For  conduction  distances  larger  than 
given  by  Equ.  (6)  n  individual  neuronal 
spikes  may  be  resolved.  For  real  data 
usually  being  measured  in  physiology 
(&],  saphenous  nerve  of  the  cat,  T«lms , 
v  »k0’A*3,6m/s  A*0,5/u  and  n=l6)  the 
minimum  distance  would  be  xfc86cm.  This 
example  shows  that  in  general  the  com¬ 
pound  action  potential  is  caused  by 
overlapping  pulse  trains  since  in  many 
cases  the  minimum  distance  (Equ.  (6)) 
is  much  larger  than  the  overall  sise  of 
the  test  animal. 

4.  The  Peripheral  Herre  as  a  Trans¬ 
versal  Filter 

Equ.  (4)  may  be  interpreted  directly  as 
a  transversal  filter  (Fig.  4) , 
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fXf.  4  Transmission  model  of  the  nerve 
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Th*  network  N  at  the  front  end  of  ih* 
filter  transforms tho  quite  arbitrary 
waveform  of  the  stimulation  pulee  into 
the  actual  wave  shape  of  the  fiber 
discharge  spike  s(t).  The  weights  of 
the  filter  are 

hi«i*Mi  (7) 

The  tiae  delays  at  the  taps  of  the  de¬ 
lay  tine  are  tjstj/i.  Thus  the  delay 
elenents  itself  are  T^t^-t^  ^  or 

T.»t«/i(i+l)  with  l>Ji*(n_i)  (8) 


Xi-tj/iU*1)  with  ldis(n_i)  (8) 

Other  than  the  ordinary  transversal 
filter  this  specific  type  has  a  non- 
uniform  tine  delay  distribution.  Inde¬ 
pendent  of  the  length  of  the  filter 
operator  the  first  delay  elenents  from 
the  right  are 

Xj-tj/2  t^stj/6  T~»tj/12  Tjksti/20... 
The  question  is  whether  the  input-out¬ 
put  relationship  of  this  filter  is  of 
the  convolution  type  or  the  cross¬ 
correlation  type.  It  has  proved  to  be 
useful  to  analyse  first  the  comaon 
discrete  linear  filter  and  the  dis¬ 
crete  cross-correlator.  The  differen¬ 
ces  to  the  discrete  operation  of  the 
peripheral  nerve  nay  than  easily  be 
shown. 

5«  The  Discrete  Linear  Filter 

The  input-output  relationship  of  a 
linear  system  in  the  tine  domain  is 
given  by  the  convolution  integral 

**  4N» 

s(t).  /s(X).h(t-T)dX«  J,( t-X)-h(X)dX  (9) 

with  the  impulse  response  h(t)  of  the 
tine  invariant  system,  for  causality 
h(t-X)«0  fer  X*t  holds.  If  h(t)  has 
the  effective  duration  T  the  condition 
of  causality  becomes  h(t-X)*0  for 
X*t-T,fiqu.  (9)  becomes 

t  T 

S(t)«  Jn(  t).h(t-t)dt«  ys(t-T)*hfl)dX(l<J 
t-T  o 

being  th  discrete  variables  t»  y-At 
and  X  m  (i -At  with  At»£  we  have 

R 

n 

S(vA»)«^“  sQ*At)»h  [<Y-|i)  At]  « 
n 

7  h(pAt)  *s  t(y-fi)]At 

|i»l 

Writing  the  arguments  as  indices 
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U*>1 
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impulse  reopens*  are  intercbangable. 
Equ.  (li)  denotes  also  a  matrix  opera¬ 
tion.  Using  the  causality  hy^o  0  for 
|i>V  th*  convolution  matrix  H  becomes 
for  the  first  expression  in- ( 1 i ) 


o  I- a 


[hn  hn-l  hn-2  hn-3**  hlJ 

The  discrete  convolution  is  expressed 

**  S  -  H.jt  (12) 

where  S  denotes  the  output  signal  vec¬ 
tor  and  g  the  input  signal  vector.  The 
n-th  row  of  the  convolution  matrix  is 
the  discrete  filter  operator  {hj,}.  Cha¬ 
racterised  by  equally  spaced  sr  pies 
of  the  impulse  response. 

Considering  th*  right  expression  in 
Equ.  (ll)  a  different  matrix  notation 
of  th*  discrete  convolution  results 

S  -  (13) 

The  transfonsation  matrix  is  now 
st  0  0  O  ....  O' 

®2  ® j  0  0  e  *  e  *  0 

*4  *3  *2  *i*  * • •  0 


vn  n-l  n-2  n-3‘*  V 

The  discrete  convolution  according  to 
(12)  or  (13)  is  performed  by  the  trans¬ 
versal  filter  with  n  sections  (Fig.  5). 


Fig.  $  Discrete  model  of  convolution 

Th*  discrete  ispuls*  response  of  th* 
filter  is  the  operator  h«(hi,h2|l>if.< 
1%).  Considering  a  tine-limited 'input 
signal  s(VAt)  and  n«4  the  complete'  set 
of  equations  determining  the  output 
signal  S(VAt)  becomes 


The  ordinary  convolution  is  a  commute, 
tive  operation.  Input  signal  and 
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*lh4  ♦  *2h3  ♦  *1h2  ♦  “4hl 
•ah4  ♦  *3h3  ♦  *4ha 
•3b4  ♦  a%h3 

*4h4 


With  Bqu.  (ta)  and  ( 13)  ia  Mind  this 
sst  of  aquations  nay  ho  interpreted  as 
two  difforont  Matrix  operations.  The 
time  delay  At  of  the  output  signal  is 
not  included. 

The  first  notation 


or  graphically  for  both 


Bqu.  (l4)  and  (15)  follow  frost  the  fact 
that  also  the  discrete  convolution 
forms  a  consultative  operation,  that  is 
ljp'£ajip*&.  Zt  can  be  seen  that  the 
transformation  matrices  Hp  or  jg>  of  the 
discrete  filter  realisable  as  trans¬ 
versal  filter  are  rectangular  ones. 
Thus,  only  in  the  special  case  of 
square  autrices  the  corresponding  in¬ 
verse  discrete  filter  is  realisable. 


for  continuous  signals  s(t)  convolution 
and  cross-correlation  are  linked  by 

CCf  (A)  •  s(t)  « h(-t)|^t 

Cross-correlation  is  identical  to  con¬ 
volution  by  the  time-reversed  filter 
operator.  Since  this  is  true  also  for 
discrete  signals  and  operators  the  phy¬ 
sical  realisation  of  the  discrete  cross- 
correlation  is  again  the  transversal 
filter.  However,  the  eleawnts  of  the 
operator  h^Ota,  1%.*,  h^-  ...  ha,h1) 
are  located  la  reversed  sequence. 
Corresponding  to  chapter  5  the  set  of 
equations  detenaiaing  the  elements  of 
the  output  vector  £  may  be  interpreted 
as  two  different  matrix  multiplications, 
for  thq  previous  example  (n«4)  the 
first  operation  becomes  tfp-i  ■  $ 


h3  hk  0  0 

b2  h3  h4  0 

h1  h2  h3  h4 
0  h1  h2  h3 


and  the  second 
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•t  *2  *3 

*2  *3  *4 

s_  e,.  0 
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The  discrete  cross-correlation  is  a 
conmutative  operation  also,  that  is 
HI*  s»sw  h.  It  should  be  noted  here 
that  the  commutative  property  of  con¬ 
volution  and  cross-correlation  is  not 
self-explanatory  but  needs  the  con¬ 
dition  of  operators  be  represented  by 
equally  spaced  samples.  As  chapter  4 
shows  is  not  the  case  for  the  peripher¬ 
al  nerve. 


The  physical  model  of  the  transmission 
properties  of  the  peripheral  nerve  is 
the  transversal  filter  having  non-uni¬ 
form  time  delay  distribution  (fig.  4). 
The  system  responds  to  a  unit  impulse 
at  t«0  after  the  time  delay  tn*tj/n 
with  h  ■((%,,  1^.,  tig,.*)  ...  hj),  where 
the  time  interval  between  two  samples 
b,  and  hi_i  is  t£«tj/i(i-l)  with  2*i*n. 
The  duration  of  the  impulse  response 
T-Mt«(l-l/n)  approaches  t.  for#-*" 
(fig.  6) .  evidently  the  time-reversed 
fiber  histogram  (Bqu.  (7)  and  fig.  2) 
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Fig.  6  Duration  of  the  diacroto 
inpul so  rooponoo 

multiplied  with  tbo  wights  i  plays 
tho  rolo  of  th#  discroto  impulse  re¬ 
sponse.  For  tho  sinplo  case  of  uniform 
distribution  N^* const.  tho  weights  of 
tho  filter  hj  have  a  triangular  shape. 
Since  the  relationship  between  delay 
and  index  i  is  non-linear  the  resul¬ 
tant  inpulse  response  is  represented 
by  non-equally  spaced  samples  (Fig.  7). 
The  maximum  delay  tj  is  a  function  of 
the  conduction  distance  x  (Equ.  2). 

Thus  there  is  a  linear  change  in  scale 
and  the  shape  of  the  iaqiulse  response 
is  not  affected. 
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Fig.  7  Discrete  impulse  response  of 
the  nerve  model  (n»6) 

It  would  follow  fron  this  that  it  must 
be  possible  to  measure  the  fiber  dia¬ 
meter  histogram  of  a  nerve  bundle 
electronically  by  stimulating  the  nerve 
with  Dirac  impulses  and  recording  the 
iaqiulse  response  thereby  eliminating 
the  time  consuming  electron-microscopic 
techniques.  However,  all  fibers  of  a 
nerve  bundle  are  able  only  tc  propagate 
the  typical  unit  discharge  vs ve forms 
s(t),  usually  called  "spike".  This  is 
equivalent  to  the  fact  that  the  input 
of  the  real  transversal  filter  (Fig.  %) 


is  inaccessible.  The  only  input  experi¬ 
mental  accessible  is  the  input  of  the 
pulse  forming  network  N.  Nevertheless 
it  may  be  possible  to  determine  the 
fiber  histogram  of  a  nerve  from  the 
compound  action  potential  S(yAt),  that 
is  the  output  of  the  model  for  unit 
discharge  input  s(t),  if  the  condition 
(6)  for  non-overlapping  spikes  is  met. 
Beyond  this  limit  compound  action  poten¬ 
tial  and  discrete  impulse  response 
become  identical.  For  the  example  of 
Fig.  7  the  limit  of  resolution  is  given 
by  x»3, 6  !J  •ims*30ml0  cm.  With  this 
minimum  conduction  distance  n*6  separa¬ 
ted  spike  waveforms  may  be  observed. 
Dividing  the  discrete  amplitudes  by 
i*l,2  ...  6  yields  the  fiber  histogram. 
This  new  technique  just  briefly  men¬ 
tioned  here  has  still  to  be  verified 
experimentally. 

Evidently,  the  transmission  properties 
of  the  nerve  may  be  described  as  a 
specific  cross-correlator  rather  than 
as  operation  of  the  convolution  type 
since  the  impulse  response  of  the  system 
is  the  time-reversed  filter  operator. 
Additionally,  it  is  easy  to  see  that 
the  transmission  behavior  of  the  nerve 
cannot  be  formulated  as  a  matrix  opera¬ 
tion  like  Equ.  (l6).  That  is  why  there 
exists  no  shifting  increment  for  opera¬ 
tors  defined  by  unequally  spaced  sam¬ 
ples  such  that  a  notation  like  Equ.  (l6) 
would  be  possible.  Therefore,  the  nota¬ 
tion  of  Equ.  (17)  must  be  used.  In  the 
following  the  cross-correlation  matrix 
s^  in  general  shall  be  derived. 

8.  The  Cross- Correlation  Matrix  of 
the  Nerve  Trunk 


Vith  the  maximum  time  delay  component 
t  ^»x/ vg»«-  At  and  eliminating  the  mini¬ 
mum  delay  component  t„*(ia/n).it  we  ob¬ 
tain  from  Equ.  (4)  with  t«V- At 

n 

S  [(  Y-*/n) AtU*  Vi"N..s[(W~f)m)At3 
i-1 


Using  the  abbreviation  for  the  shifting 


increment  (n-i)m 

i  n.  i 

(18) 

it  follows 

n 

W  21  VV, 

n  i»t  1 

(19) 

In  general  the  shifting  parameter  r^ 
is  non  integer.  The  elements  *ywr.. 
are  the  samples  of  the  unit 
discharge  waveform  taken  at  the  times 
t*(y-TijAt.  Zf  the  unit  spike  s(t)  of 
the  fibers  has  the  time  duration 
Tap. At  the  time  length  of  the.  compound 
potential  S(y*At)  becomes  (Equ.  (5)) 

Tr«Cj>+m(  l-jJjJ  At*  ».At  (20) 
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The  number  of  rows  of  the  correlation 
matrix  will  therefore  be  «+l  or  £z] 
depending  on  whether  z  takes  integer 
values  or  rot.  [sjdenctes  in  the  latter 
case  the  next  integer  number  following 
s.  Zt  is  useful  to  consider  the  corre¬ 
lation  matrix  column  by  column.  Ve  ob¬ 
tain  the  V-th  element  of  the  i-th  co¬ 
lumn  vector  e(y-rj ) At  » 

,  (21) 
(s(  fr<}  -r.ej)At  for fr.  Toy*  [r.Tfp-1 
JstjAt)  4  for  r4  «>**  i\j>p 


for  0 
for  0 


feiJ* 


eve 

«y«*rj"-l 


with  j>0,l,2  ...p.  Hie  upper  row  is 
valid  for  non-integer  valves  of  r^, 
the  lower  for  integer  values.  Thus  the 
i-th  column  vector  of  the  matrix  s^. 
has  the  following  structure: 


r^  non  integer 


integer 
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0 

0 

a 

*ri] 

e 

0 

0 

“ri 

*0 

*Cri] 

*1 

•trJ-i*2 

*2 

*[rJ  -ri+3 
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>p 

*3 
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• 
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The  coaqplete  cross-correlaticn  matrix 
has  than  the  form: 


123 


0 


iw-nw 


or 

*♦1 


The  construction  piocedure  of  the  cor¬ 
relation  matrix  shall  be  explained  by  a 
simple  example. 

Example:  p*3.  n*4,  **6 
from  Equ.  (20) r*7i5  thus  [*3*8 
from  Equ.  (itt)  we  obtain  the  shifting 
parameters 

I 

Regarding  Equ.  (21) 
the  complete  matrix 
may  be  constructed 

■o" 


*2 

*3 

0 

0 

0 
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The  simple  example  shows  the  unequally 
spaced  samples  of  e(t)  forming  the  rows 
of  the  matrix.  The  vector  of  the  com¬ 
pound  action  potential  represented  by 
equally  spaced  samples  S(yAt)  is  than 
obtained  by  the  matrix  operation  S«s^- h 
where  h  denotes  as  earlier  the  filter 
operator  representing  the  fiber  diameter 
histogram  multiplied  by  the  weights  i. 

It  may  easily  be  shown  that  compound 
action  potential  S  and  impulse  response 
hk=(h4,  b.3,h2.h1)  become  identical  if  the 
conduction  distance  is  beyond  the  limit 
given  by  Equ.  (6).  If  x  increases  than 
the  number  of  the  rows  fzj  or  z+1  in¬ 
creases,  too.  For  the  example  the  limit 
for  non-overlapping  spikes  would  bs 
m  *  pn(n-l)*12  for  p*l  and  z*10. 
Choosing  m»l5  yields  **12,25  —00*13 
The  shifting  increments  are  in  this 
case: 
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The  correlation 
matrix  thus 
becomes 
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Multiplying  tha  matrix  by  the  filter 
operator  h  yields  tha  discrete  impulse 
response  hfe  being  represented  by  the 
four  unequally  spacad  samples  h^.h-.bg, 
and  h  .  3 
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Abstract 

A  plausible  method  for  classification 
of  electrocardiograph  data  as  comi..g  from  a 
normal  or  ah  abnormal  subject  using  the  Walsh- 
Hadamard  Transform  is  demonstrated.  Several 
types  of  ECG  signals  were  obtained  from  re¬ 
search  canines.  These  signals  were  declared 
normal  or  abnormal  by  the  veterinary  cardiol¬ 
ogist  at  Karsas  State  University's  Dykstra 
Veterinary  Hospital.  The  Walsh-Hadamard 
power  spectrum  of  these  signals  was  then  ob¬ 
tained  and  four  of  these  spectral  points  were 
used  to  train  a  specific  pattern  classifier. 
The  results  of  using  the  classifier  show  per¬ 
fect  classification  of  the  normal  and  ab¬ 
normal  signals  from  a  given  subject.  In  the 
case  of  signals  from  a  mixed  population,  a 
population  consisting  of  samples  from  all  sub¬ 
jects,  ten  spec  am  points  were  used  to  train 
the  classifier  .hich  proved  to  be  eighty-nine 
per  cent  correct. 

The  results  suggest  that  the  Walsh- 
Hadamard  power  spectrum  could  prove  useful  in 
characterizing  ECC's  for  the  purpose  of  auto¬ 
matic  classification.  Thus,  recommendations 
for  future  work  along  these  lines  are  in¬ 
cluded.  Several  applications  of  these  re¬ 
sults  are  suggested. 

Introduction 

Many  applications  of  the  principles  of 
engineering  to  medicine  have  been  made  in  re¬ 
cent  years.  One  such  application  Is  the  use 
of  the  digital  computer  to  process  the  vast 
amounts  of  medical  data  available  [1,  2]. 

The  use  of  the  computer  to  aid  in  diagnosis 
comes  as  s  result  of  Its  sblllty  to  handle 
this  data. 

One  of  the  signals  available  for  proc¬ 
essing  is  the  electrocardiograph  signal  (ECC) . 
This  signal  Is  generated  by  the  hesrt  muscle 
during  the  cardiac  cycle.  The  signal  la 


measured  using  a  lead  system,  which  is  a  pav- 
tlcular  placement  o;'  measurement  electrodes 
on  the  surface  of  the  body.  The  shape  and 
frequency  of  this  rlgnal  provides  the  cardiolo¬ 
gist  with  information  pertaining  to  the  phys¬ 
ical  well-being  of  the  heart.  The  computer 
can  then  be  used  to  distinguish  between  normal 
and  abnormal  ECG  signals.  It  is  used  most 
commonly  for  mass  screening  and  for  patient 
monitoring.  In  mass  screening  the  goal  is  to 
automatically  detect  abnormalities  in  large 
populations.  In  individual  monitoring  a 
single  patient  is  monitored  and  any  future 
changes  in  his  ECG  can  then  be  detected. 

Past  work  has  emphasized  the  time  domain 
approach  [1,  2],  With  this  approach  the  para¬ 
meters  a  cardiologist  looks  for  in  the  time 
domain  are  measured  and  compared  to  a  range 
of  known  characterlatlcs  for  normal.  This 
method  has  probably  been  the  moat  popular 
since  the  parameters  it  uses  are  those  the 
cardiologist  ordinarily  examines. 

Frequency  analysis,  however,  can  be  an 
Important  tool  when  used  with  the  computer. 

Past  work  has  shown  that  in  many  cases  abnor¬ 
malities  are  accompanied  by  an  Increase  in  the 
high-frequency  content  of  the  ECC.  one  such 
frequency  analysis  Is  the  method  using  the 
Walsh-Hadsme.rd  Transform  (WHT)  [3]. 

Fundamentals  of  Electrocardiography 

The  electrocerdlogrem  le  a  measure  of 
the  electrical  activity  o'  the  heart.  This 
electrical  signal  la  generated  during  the 
cardiac  cycle  by  the  depolarisation  and  re¬ 
polarization  of  the  heart  muscle  cells  during 
their  process  of  contraction  and  relaxarlon. 
The  actual  potential  measured  across  the  cell 
membrane  is  due  to  an  Ionic  gradient.  The 
changes  In  this  Ionic  gradient  occur  with  the 
muscle  action  of  the  heart  and  rhesc  changes 
in  the  ionic  potential  are  recorded  as  the 
ECG.  (See  Pig.  1). 
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The  heart  Is  a  cyclic  pump.  The  cardiac 
cycle  Includes  pumping  blood  from  the  ventri¬ 
cles  to  the  body  and  to  the  lungs  as  well  as 
the  return  of  blood  from  the  body  and  the  lungs 
to  the  heart.  The  right  and  left  ventricles 
are  the  pumping  chambers  of  the  heart  with  the 
right  sending  oxygen  deficient  blood  to  the 
lungs  and  the  left  sending  oxygen-laden  blood 
to  the  body. 

The  atria  are  the  receiving  chambers  of 
the  heart  with  the  left  receiving  oxygen-laden 
blood  from  the  lungs  and  the  right  receiving 
oxygen  deficient  blood  from  the  body. 

The  ECG  under  most  circumstances  may  be 
assumed  to  be  periodic  since  it  is  generated 
during  the  cardiac  cycle.  The  sino-atrlal 
node  initiates  the  stimulus  for  the  contraction 
of  the  heart  muscle.  The  stimulus  travels 
across  the  atria  causing  them  to  contract 
and  then  after  a  short  delay  in  passing  through 
the  atrlo-ventricular  node  it  passes  down  the 
septum  and  on  through  the  ventricles  which 
then  contract.  The  depolarizations  of  the 
atria  and  of  the  ventricles  are  evidenced  by 
the  P  wave  and  the  QRS  complex  respectively 
as  shown  in  Figure  1.  After  these  muscle  cells 
contract  they  return  to  their  initial  state 
through  the  process  of  repolarlzation.  The 
repolarization  of  the  atria  is  masked  by  the 
QRS  complex  while  the  repolarization  of  the 
ventricles  produces  the  T  wave  of  the  ECG, 

The  ECG's  waveform  is  dependent  upon  the 
recording  electrodes'  placement  on  the  body. 
This  arrangement  is  called  a  lead  system.  The 
lead  system  used  in  this  study  was  the  McFee 
orthogonal  lead  system.  It  consisted  of  10 
leads  and  a  ground.  This  lead  system  theore¬ 
tically  measures  the  ECG  along  3  mutually  or¬ 
thogonal  axes  as  illustrated  in  Figure  2. 


The  Walsh-Hadamard  Transform 

The  Walsh-Hadamard  Transform  (WHT)  or 
Bifore  (Binary  Fourier  Representation)  is  aa 
orthogonal  transformation  in  whicn  square  waves 
form  the  basis  set.  These  square  waves  are 
analogous  to  the  sine  waves  of  the  Fourier 
Transform.  The  one  dimensional  Walsh-Hadamard 
Transform  is  defined  as 

|Bx(n)j  »  |  (H(n)l  £x(n;j  (1) 


where  n 


l°g2N 


(yn)]  is  an  (NX1)  vector  whose  compo¬ 
nents  ^(k),  k  ■  0,  1 . (N-l)  are  the 

transform  coefficients. 


[H(n>]  is  an  N  x  N  Hadamard  matrix, 

J X(n)j  represents  the  sampled  values  of  an 
in  the  form  of  an  (NX1)  vector. 
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The  power  spectrum  corresponding  to  the 
above  components  is  defined  as  [3] 
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This  power  spectrum  possesses  two  useful 
properties.  (1).  The  spectral  points  Pi,  1“0, 

1 . log2N  are  invariant  to  shifts  of  a 

sampled  ECG  signal  X(m) ;  and  (2) .  They  also 
represent  the  distribution  of  power  in  the  ECG. 


The  ECG  is  an  important  adjunct  used  by 
the  cardiologist  in  diagnosing  heart  ailments. 
It  gives  information  used  in  the  diagnosing  of 
such  conditions  a3  myocardial  Infarction,  and 
many  systemic  diseases  affecting  the  heart. 

Any  aid  to  the  interpretation  of  the  EGG  is 
thus  an  aid  to  the  prevention  of  death  from 
heart  disease. 

As  previously  suggested,  most  past  efforts 
in  automating  the  Interpretation  of  the  ECG 
have  focused  on  the  time  domain  approach. 

This  is  perhaps  due  to  the  fact  that  cardiolo¬ 
gists  are  familiar  with  and  can  attach  sig¬ 
nificance  to  the  time  domain  signal.  The 
frequency  characteristics  of  the  ECG  have  been 
used  mainly  for  specifying  the  recording  and  , 
monitoring  equipment  necessary  for  time  domain 
analysis.  In  this  study  the  frequency  approach 
appeared  to  be  valuable  also  in  distinguishing 
between  normal  and  abnormal  ECG's. 


The  WHT  used  for  the  case  of  two  channels 
of  ECG  data  as  shown  in  Figure  3  is  defined  as 
follows: 

[B(n^n2>  ]  -  [H(N1> ]  [XO^.nJ]  [H(N2>] 

(3) 

nl  "  log2Nl 
n2  -  l°g2N2 

[B  (n1»n2>J  is  an  (Nj  x  N^)  transform  matrix 

[X(n^,n2)J  is  an  (  x  Nj)  data  matrix 

and  [H(k>]  is  a  (2k  x  2k)  Hadamard  matrix. 

In  the  application  of  interest  (see  Fig'.  3) , 

«  2  and  N2  “  32.  Thus  the  two-dimensional 
WHT  in  (3)  can  be  expressed  in  terms  of  the 
one-dimensional  WHT  of  the  "sum”  and  "differ-, 
ence"  channels  defined  by  X(k)  +  Y(k),  k  «  0, 
1,  ....  31  and  X(k)  -  Y(k)  k  -  0,  1,  .  . 

.  .  31  respectively. 
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The  WIIT  power  Hpectrum  In  minted  to  the 
■H  lie  rote  Fourier  power  spec  Turn  in  the  fo]  low¬ 
ing  nu  nner. 
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and  C  (i),  i  «  0,  1,  .  .  .  N  ere  the 
discrete  Fourier  Transform  power  spectrum 
points . 


Classification  Considerations 

A  training  algorithm  which  uses  a  least- 
squares  mapping  technique  was  used  [5,  6]. 

The  basic  idea  used  was  to  map  (in  the  least 
squares  sense)  the  training  samples  of  a  class 
k,  k  -  1,  2  .  .  K  into  a  unit  vector  in 
a  K-dimensional  decision  space.  All  the  com¬ 
ponents  of  are  zero  except  for  the  Kth  one 
which  is  unity.  The  corresponding  mapping 
matrix  is  obtained  during  the  training  process. 
Then,  the  trained  classifier  assigns  an  in¬ 
coming  pattern  to  class  i0  if  the  pattern  la 
mapped  closest  to  the  unit  vector  V.  in  the 
decision  space.  o 

Discussion  of  Results 


KCG  Put a  Acqul h 1 L Inn 

The  intent  of  this  study  was  to  demon¬ 
strate  the  fearibility  of  automatically  classi¬ 
fying  ECG's  using  the  W11T.  The  experimental 
data  was  obtained  from  a  group  of  laboratory 
canines.  The  canine  was  chosen  because  of  the 
similarity  of  its  heart  and  ECO  to  that  of  the 
human.  This  similarity  would  then  allow  the 
extension  of  the  techniques  developed  to  the 
human . 

The  signals  were  recorded  at  Kansas  State 
University's  Dykstra  Veterinary  Hospital  with 
the  system  shown  in  Figure  4.  The  procedure 
used  in  recording  the  data  included  anesthe¬ 
tizing  the  canine,  recording  its  normal  ECG 
and  then  inducing  various  cardiac  abnormali¬ 
ties  while  continuing  to  record  its  ECC.  The 
resulting  signals  were  then  interpreted  by  a 
veterinary  cardiologist  and  classed  as  normal, 
abnormal  or  questionable. 

One  segment  of  the  ECG  signal  was  chosen 
upon  which  to  distinguish  the  classes  of  ECG's. 
This  segment  was  the  QRS  segment  which,  as 
stated  earlier,  corresponds  to  the  depolariza¬ 
tion  and  contraction  of  the  ventricles.  Figure 
3  shows  the  two  channels  of  the  sampled  QRS 
segment  used.  Not  all  abnormalities  can  be 
detected  in  tills  segment  but  it  was  felt  that 
enough  of  them  could  be  to  warrant  using  it 
as  a  first  step  in  this  study. 

The  sampling  of  the  ECG  began  with  the 
start  of  the  QRS  complex  and  ended  80  millisec¬ 
onds  later  after  having  recorded  32  samples. 
Consequently,  the  corresponding  frequency  anal- 
aysis  applies  to  the  frequency  interval  of 
0  1  F  1  200  11  •  T,,e  x  and  Y  leads  of  the 
Me Fee  orthogonal  lead  system  were  sampled 
simultaneously  to  obtain  a  (2  x  32)  matrix  of 
data  points  which  waB  then  used  to  compute 
the  two-dimensional  WIT  power  spectrum.  The 
resulting  spectrum  consisted  of  12  WIT  points 
as  follows : 


Figure  5  shows  the  results  obtained  using 
different  numbers  of  components  of  the  power 
spectrum.  These  results  were  obtained  using 
three  classes  for  training;  normal,  abnormal 
and  questionable.  The  abnormal  and  question¬ 
able  classes  were  then  combined  into  one  class 
and  the  efficiency  was  calculated  using  these 
two  classes.  For  this  case  the  signals  from 
the  canines  studied  were  mixed.  As  can  be 
Been,  the  efficiency  of  classification  in¬ 
creases  to  89Z  when  10  components  are  used. 
Fig.  6  shows  the  groupings  used  from  4-10 
WHT  power  spectrum  points. 

A  related  measure  of  the  success  of 
classification  involves  the  measurement  of  the 
number  of  abnormal  signals  classed  as  normal. 
When  this  type  of  error  occurs  the  individual 
in  question  might  not  receive  the  medical 
care  he  should  have.  Figure  7  shows  the  fre¬ 
quency  of  this  type  of  error  versus  the  number 
of  components  used  to  classify.  As  can  be 
seen  the  best  results  are  obtained  for  the 
case  of  10  components.  The  other  type  of 
error,  that  of  a  normal  classed  as  abnormal, 
is  not  as  serious,  since  the  Individual  would 
ordinarily  seek  further  medical  care  anfl  other 
tests  would  show  him  to  be  normal. 


The  classification  process  was  then  ap¬ 
plied  to  detect  variations  from  normal  within 
a  given  canine.  The  power  spectrum  points  of 
the  canine's  normal  were  compared  with  that 
cf  its  induced  abnormals  using  a  two  class 
version  of  the  classifier  mentioned  abeve. 
With  four  components  used  the  classifier 
was  100X  efficient. 


Concluding  Remarks 


The  results  of  this  study  suggest  three 
plausible  uses  for  the  techniques  developed. 
First,  in  patient  monitoring  a  normal  or  ac¬ 
ceptable  signal  would  be  obtained  from  the 
individual  being  monitored.  Then  variations 
from  this  normal  could  be  detected  and  could 
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alarm  the  appropriate  medical  personnel  to 
the  change  in  the  patient's  condition.  This 
application  is  strongly  supported  by  the  suc¬ 
cess  in  separating  normal  from  abnormal  within 
a  given  canine. 

A  second,  related,  application  would  be 
for  use  in  serial  electrocardiography.  In 
serial  electrocardiography  an  individual's 
normal  ECO  is  recorded  for  comparison  with 
one  recorded  at  a  later  time.  Any  changes 
detected  would  again  be  called  to  the  atten¬ 
tion  of  appropriate  medical  personnel. 


Fig.  1  The  Electrocardiograph  Signal  as 
Recorded  on  Lead  X. 


Mass  screening  if  the  third  application. 

In  this  case  large  numbers  of  normal  and  ab¬ 
normal  ECG's  would  be  collected  for  the  train¬ 
ing  of  the  classifier.  The  resulting  classi¬ 
fier  would  then  be  used  to  detect  abnormal 
ECG's  in  large  populations.  The  success  of 
the  classifier  in  separating  normal  as  shown 
in  figure  5  and  abnormal  in  the  mixed  popula¬ 
tion  supports  this  application. 

This  study  has  shown  the  feasibility  of 
using  the  Walsh-Hadamnrd  Transform  approach 
to  detect  cardiac  disease. 
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Fig.  2  The  Placement  of  Electrodeb  on  the 
Canine  Using  the  McFee  Lead  System. 
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Fig.  3  The  se-'pled  QRS  Interval  as  Recorded 
With  the  McFee  Lead  System  on  Leads  X 
and  Y.  N  -  31. 
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Fig.  4  The  Data  Acquisition  System  Used  for 
Electrocardiograph  Classification. 
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Fig.  5  The  Success  of  the  Classifier  Shown 
as  a  Function  of  the  Number  of  WHT 
Power  Spectrum  Points  Used. 


Fig.  6  The  Grouping  of  Componets  Used  to 
Classify  ECG  Signals. 
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Fig.  7  The  Per  Cent  Abnormal  Classed  is 
Normal  as  a  Function  of  the  K umber 
of  WHT  Power  Points  Used.  This  is 
the  More  Serious  Type  of  Error. 
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HEART  RATE  REPRESENTATION  USING  WALSH  FUN( 
C.  W.  Thomas  &  A.  T.  Welch 
The  University  of  Texas  at  Austin 


Introduction 

The  common  interpretation  of  the  term  "heart 
rate"  is  the  number  of  heart  beats  per  minute 
measured  by  feeling  the  pulse  within  an  artery, 
listening  to  heart  sounds  or  looking  at  an  elec¬ 
trocardiogram.  In  each  case,  the  heartbeats 
are  counted  for  a  minute  and  that  number  is 
called  the  heart  rate  or  pulse  rate.  Although 
heart  rate  is  considered  a  relatively  stable  mea¬ 
surement,  there  is  a  large  variation  in  the  times 
between  heart  beats.  The  Interval  between 
beats  may  be  determined  from  the  electrocardio¬ 
gram  as  shown  in  Figure  1  (a) .  The  reciprocal 
of  this  interval  is  designated  as  instantaneous 
heart  rate.  In  this  paper,  we  view  heart  rate  as 
a  piecewise,  continuous  function  whose  value 
at  any  time  is  the  instantaneous  heart  rate 
(See  Figure  1  (b)) .  The  average  value  of  the  con¬ 
tinuous  heart  rate  function  over  one  minute  is 
the  classical  heart  rate.  This  general  interpre¬ 
tation  of  heart  rate  is  necessary  if  we  are  in¬ 
terested  in  the  dynamic  effects  of  body  temper¬ 
ature,  respiration,  emotional  state,  etc.,  upon 
the  beating  of  the  heart. 

Variations  of  the  heart  Intervals  are  more 
medically  and  physiologically  significant  tt 
the  mean  heart  rate  or  even  the  wave  shape  ~r 
the  electrocardiogram.  This  is  obviously  true 
in  abnormal  heart  conditions  in  which  extra 
beats  or  missing  beats  are  common  symptoms . 
in  the  normal  human,  a  large  variation  of  heart 
intervals  with  respiration  is  usually  indicative 
of  good  health.  Therefore,  a  more  general  rep¬ 
resentation  of  heart  rate  than  the  one  minute 
averages  may  be  clinically  useful.  In  many 
clinical  situations ,  especially  intensive  care 
or  coronary  care  units,  most  medical  and  phy¬ 
siological  research,  and  even  astronaut  moni¬ 
toring,  the  electrocardiogram  is  routinely 
monitored  and  the  times  of  occurrence  of  heart 
beats  are  available  for  analysis. 

Representation  of  Heart  Rate 

Womack  (1)  has  attempted  to  extract  respira¬ 
tion  information  from  instantaneous  heart  rate 
by  frequency  analysis  procedures.  In  order  to 
work  with  a  bandlimited  system,  the  discrete 
level  heart  rate  function  of  Figure  1(b)  was 
represented  as  a  continuous  function  as  shown 
in  Figure  1(c).  This  is  a  convenient  represen¬ 
tation  even  though  it  is  not  directly  measurable. 


A  representation  we  wish  to  consider  in 
detail  is  a  sequence  of  impulses.  The  time  of 
occurrence  of  each  impulse  corresponds  to  the 
time  of  the  heartbeat  (R  wave  oeak  of  the  elec¬ 
trocardiogram)  .  That  is,  the  occurrence  of 
heartbeats  may  be  represented  as: 

I  =  p(t-Tt)  (1) 

where  T  is  the  time  of  occurrence  of  die  heart 
beat. 

Definition  of  Heart  Rate  Using  Walsh  Transform 

In  the  above  representation  of  heart  rate, 
the  time  of  occurrence  oi  each  heartbeat  is 
marked  by  an  im .  ulse.  If  I  Is  the  input  to  a 
flip-flop,  the  output  of  the  device  would  be  a 
two-level  signal  which  may  be  mathematically 
represented  by  a  sequence  of  unit  step  func¬ 
tions  as: 

H  =  -1  +  2  £  IU  (t~T21_1)  -  U(t-T21)]  (2) 

The  instantaneous  heart  rate  is  determined 
from  the  time  between  zero  crossing.  The  rate 
of  heart  beats  is  represented  by  the  rate  of 
zero  crossings  of  the  heart  rataplan  function 
defined  by  equation  2. 

If  the  heart  rate  is  constant,  the  gene¬ 
rated  time  function  will  be  a  square  wave.  If 
the  heart  rate  varies,  the  zero  crossings  of  the 
square  wave  will  vary  and  the  Instantaneous 
heart  rate  is  die  instantaneous  rate  of  zero 
crossings  of  the  heart  rataplan  function. 

To  reprerent  the  rate  of  zero  crossings,  we 
periodically  sample  the  heart  rataplan  function 
(or  the  state  of  the  flip-flop)  for  the  desired 
time  period  and  take  the  Walsh  Transform  of  the 
sampled  function.  The  sequency  coefficients 
from  the  Walsh  Transform  represent  the  heart 
rate  function. 

There\are  several  advantages  to  this  repre¬ 
sentation  of  heart  rote.  First,  the  time  func¬ 
tion,  i.e.  the  heart  rataplan  function,  is 
simple  to  generate  with  «  computer  or  with  a 
flip-flop.  Second,  it  can  be  sampled  uniformly 
allowing  flexibility  in  die  choice  of  time  period 
and  the  number  of  samples  in  that  period. 

Third  it  allows  straightforward  computation  of 
the  Walsh  Transform  coefficients  which  repre¬ 
sent  heart  rate.  ' 


Experimental  Data 

In  the  normal  human  and  many  other  animals, 
the  most  prominent  heart  rate  variation  Is  the 
sinus  arrhythmia,  i.e.  the  variation  in  heart 
rate  with  respiration  as  described  by  Richardson 
et  al  (2) .  In  this  paper  we  use  four  sets  of  data 
in  which  the  sinus  arrhythmia  is  cloarly  present 
The  first  two  sets  are  simulations  of  square 
wave  and  sine  wave  variations  in  heart  inter¬ 
vals.  The  third  set  is  data  taken  from  a  sub¬ 
ject  who  was  breathing  sinusoidally  as  des¬ 
cribed  in  Womack  (1).  In  the  fourth  set  of  data, 
the  respiration  is  unknown,  but  the  stage  of 
sleep  is  known  from  other  considerations  as 
described  by  Welch  (3) . 

In  the  two  sets  of  simulated  data  a  constant 
rate  of  72  beats  per  minute  (intervals  of  5/6 
second)  is  modulated  according  to 

T  =  Tt  l  +  5/6  +  (M/72)  sign  Q  (3) 
and 

Ti  =  Ti-1  +  5/6  +  Q  M> 

?ttR 

where  Q  =  sin  ( TJ,_1) 

M=  amplitude  of  the  Interval  modulation 
and  R  =  respiration  rate  in  breaths  per  minute 

In  equation  3  the  sinus  anhythmia  is  simu¬ 
lated  as  a  square  wave  modulation  of  the  heart 
in*  jrvcls,  while  equation  4  simulates  a  sinu¬ 
soidal  sinus  arrhythmia.  In  both  cases,  the 
amplitude  of  the  sinus  arrhythmia  is  represented 
by  M.  When  M  =  0,  the  heart  rate  is  constant, 
i.e. ,  our  heart  rataplan  function  is  a  square 
wave.  For  non-zero  values  of  M,  the  heart 
interval  in  equation  4  vary  sinusoidally  between 
5/6  -  M/72  and  5/6  +  M/72  or  the  heart  rate 
varies  between 

_Z2 _  _ Z2 _ 

1  +  M/60  1  -  M/60  ' 

Notice  that  the  variation  in  heart  rate  is  not 
exactly  sinusoidal  since  the  mapping  from  heart 
intervals  to  heart  rate  is  nonlinear.  We  have 
assumed  that  sinusoidal  sinus  arrhythmia  means 
sinusoidal  variation  of  heart  interveds  not  sinu¬ 
soidal  variation  of  heart  rate. 

In  equation  3,  non-zero  values  of  M  yield  a 
square  wave  modulation  of  heart  Intervals . 

While  this  type  of  sinus  arrhythmia  is  not  ex¬ 
perimentally  possible,  it  does  furnish  a  com¬ 
parison  with  the  sinusoidal  case  which  can  be 
closely  approximated  in  the  laboratory. 

Simulated  data  was  obtained  using  equations 
3  and  4  with  M  =  4  and  3  and  R  =  4,  6,  8,  10, 
12,  and  14  breaths  per  minute.  The  mean  in¬ 


terval  was  5/6  seconds  which  corresponds  to  a 
rate  of  72  beets  per  minute.  One  minute  seg¬ 
ments  were  used  to  construct  the  heart  rataplan 
function  which  was  sampled  at  1024  per  minute. 

The  Walsh  Transform  of  the  sampled  function 
from  the  square  wave  variation  was  calculated 
for  each  one  minute  segment  and  the  Walsh 
Transform  coefficients  plotted  in  Figure  2.  As 
in  frequency  modulation  of  sinusoids.  Increased 
modulation  amplitude  M,  resulted  in  an  increase 
in  number  of  major  coefficients  around  the  fuivld- 
mental. 

The  effect  of  increasing  the  frequency  of  the 
modulation,  i.e.  increasing  the  simulated  res¬ 
piration  rate,  is  not  so  easily  described  and 
appears  to  be  frequency  dependent.  The  trans¬ 
form  has  fewer  major  coefficients  for  rates  of  8 
and  12  than  for  the  other  rates.  However  the 
coefficients  obviously  vary  with  die  modulation 
frequency. 

The  Walsh  Transform  of  the  simulated  sinu¬ 
soidally  varying  heart  Intervals  are  shown  in 
Figure  3.  Again  the  number  of  significant  co¬ 
efficients  varies  with  both  amplitude  and  fre¬ 
quency  of  the  sinusoidal  modulation. 

The  data  from  the  hum.,  subject  breathing 
sinusoidally  was  used  t ;  . .  nstruct  one  minute 
segments  of  heart  ratap'—.i  functions  whose 
Walsh  Transforms  are  shown  in  Figure  4.  The 
frequency  of  die  sinusoids  are  the  same  as  in 
the  simulated  data  in  Figure  3.  However,  the 
simulation  was  sinusoidally  varying  heart  inter¬ 
vals  while  the  data  from  the  human  subject  was 
sinusoidal  respiration. 

The  Welsh  Transform  of  the  human  data  in 
Figure  4  is  similar  to  both  sets  of  simulated 
data  in  Figure  2  and  3.  The  human  data  is 
better  correlated  with  the  simulated  data  with 
the  larger  modulation  amplitude.  The  plots  in 
Womack  (1)  show  a  heart  rate  variation  of  about 
15  beats  per  minute.  The  simulated  data  with 
M  =  8  has  about  the  same  heart  rate  variation . 
Therefore,  the  correlation  with  the  human  data 
should  be  higher  than  for  M  =  4. 

The  fourth  set  of  data  was  obtained  during  a 
normal  night  of  sleep.  Respiration  in  the  sleep¬ 
ing  human  is  not  sinusoidal  and  its  amplitude 
and  rate  vary  with  sleep  stage. 

The  heart  rataplan  function  was  constructed, 
sampled,  and  Walsh  Transformed  for  the  sleep 
data  as  in  the  previous  sets  of  data.  The  he*rt 
rate  functions  plotted  in  Figure  5  obviously 
change  with  sleep  stage,  but  the  respiration 
rates  cannot  be  determined  by  visual  comparison 
with  Figures  2  and  3. 


This  Is  not  surprising  sines  the  variation  in 
heart  intervals  Is  certainly  not  sinusoidal  or 
square  wave,  and  as  shown  in  Figures  2  and  3, 
tire  number  of  significant  coefficients  varies 
with  modulating  frequency.  The  non-sinusoidal 
non-symmetric  modulation  of  fire  heart  Intervals 
during  sleep  seems  to  increase  the  complexity 
of  the  heart  rate  function. 

To  compare  the  Walsh  Transform  of  the 
heart  rataplan  frmctlon  with  fire  Fourier  Trans¬ 
form  of  the  same  frmctlon,  both  transforms  of 
the  sleep  data  are  shown  In.Figure  6.  First  the 
coefficients  from  both  transforms  are  plotted, 
then  the  square  root  of  the  sum  of  the  squares 
of  the  two  coefficients  at  each  sequency  and 
frequency  are  plotted. 

The  latter  plots  represent  power  at  bands  of 
sequency  and  frequency.  In  other  words,  they 
are  the  amplitude  spectra  as  defined  by  Har- 
muth  (4). 

Conclusions 

The  representation  of  heart  rate  using  the 
Walsh  Transform  has  been  presented.  The  data 
shows  that  variations  In  heart  rate  are  repre¬ 
sented  by  several  coefficients  In  the  transform. 
The  number  of  significant  coefficients  depends 
on  the  amplitude,  period,  and  complexity  of 
the  modulating  function. 

We  have  not  solved  any  problem,  but  we 
have  demonstrated  a  tool  which  may  be  useful 
in  problems  involving  the  use  of  heart  rate  and 
especially  variance  of  heart  rate.  We  have 
used  only  one  time  period  and  one  sampling 
rate,  but  these  two  parameters  may  be  chosen 
to  fit  a  particular  problem.  Such  flexibility  and 
the  computational  speed  make  this  technique 
potentially  useful. 
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Figure  2. 


Heart  rate  functions  from  tho 
simulated  square  wave  variation  of 
heart  intervals.  The  sequency 
scale  is  one  to  120  zpm  and  the 
vertical  scales  are  the  same  for  all 
plots. 


Figure  3.  Heart  rate  functions  from  the 

simulated  sine  wave  "ariatlon  of 
heart  intervals.  The  sequency  and 
vertical  scales  are  the  samo  as  in 
Figure  2. 


Figure  4.  Heart  rate  functions  for  the  two 
human  subjects  breathing  sinu¬ 
soidally.  The  breathing  rates  and 
the  plot  scales  are  the  same  as  in 
Figures  2  and  3. 


Figure  5.  Heart  rate  functions  for  the  sleep¬ 
ing  human  in  different  stages  of 
sleep.  The  plot  scales  are  the 
same  as  in  the  previous  three  fig¬ 
ures.  Stage  O  is  the  awake  but 
drowsy  state,  stages  1,  2,  3,  and 
4  are  progressively  deeper  sleep, 
and  stage  5  is  at  the  level  of  stage 
1  but  with  REM  (rapid  eye  movement 
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Figure  6.  Comparison  of  the  Walsh  Transform 
(left)  and  the  Fourier  Transform 
(right)  of  the  heart  rataplan  function 
for  the  sleeping  human  in  stages  4 
and  5 .  The  upper  plots  are  coeffi¬ 
cients  from  the  transform,  while  the 
lower  plots  ere  the  amplitude  spec¬ 
tra.  The  scales  for  the  upper  plots 
are  the  same  as  in  the  four  previous 
figures.  In  the  amplitude  spectra 
plots,  the  sequency  scale  is  1  to 
240  zpm. 


Figure  1 .  Deflnitiou  of  heart  rate  from  the 
electrocardiogram . 
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Introduction 

Brain  wave  (EEG)  analysis  is  a  very  impor¬ 
tant  tool  in  meaty  research  and  clinical  appli¬ 
cations.  Hie  clinical  diagnosis  of  epilepsy  and 
sleep  research  are  two  areas  which  owe  their 
development  almost  entirely  to  the  discovery  of 
the  EEG.  These  studies  always  entail  the  pro¬ 
cessing  of  large  amounts  of  data,  and  have 
plotted  many  investigators  to  try  autaaated 
techniques  to  assist  in  the  data  analysis  and 
in  attempts  to  discover  new  knowledge  about  the 
EEG. 

Fourier  spectral  analysis  is  the  technique 
most  widely  applied.  Applications  include  the 
analysis  of  EEG  data  collected  from  astronauts 
[1]  and  the  discrimination  among  states  of  con¬ 
sciousness  (sleep  and  wakefulness)  [2] .  The 
utilization  of  the  EEG  to  classify  sleep  into 
several  stages  [3]  has  led  to  the  development  of 
automated  systems  for  the  cocputer  classifi¬ 
cation  of  sleep  stages  [2,  4,  5]. 

This  study  was  carried  out  to  determine  if 
the  Walsh  Transform  could  be  utilized  in  dis¬ 
criminating  between  sleep  stages  and  to  caviare 
Walsh  and  frequency  EEG  spectra. 

The  huaan  sleep  EEG,  as  shown  in  Figure  1, 
consists  of  six  sleep  stages  (stage  W,  1,  2,  3, 
4,  and  REM).  The  sleep  stage  W  (wakefulness) 


is  characterized  by  a-wsve  activity  (8  -  12  Hz 
nearly  sinusoidal  activity) ,  and  stage  1  by  a 
relatively  low  voltage,  mixed  frequency  (2-7 
Hz)  EEG.  Stage  2  is  defined  by  presence  of 
phasic  activities  of  approximately  1  second 
duration  (sleep  spindles  and/or  K- complexes) 
superimposed  on  a  background  of  relatively  low 
voltage,  mixed  frequency  EEG  activity  [3]. 

Stage  3  and  4  contain  moderate  and  large  amounts 
(in  time)  of  high  amplitude,  .5-2.5  Hz  activity 
respectively.  RB4  sleep  -  thought  to  coincide 
with  periods  of  dreaming  -  has  an  EEG  similar 
to  sleep  stage  one,  but  is  distinguished  by 
rapid  eye  movements  and  or  the  attenuation  of 
the  electromyogram. 

Methodology 

Three  human  sleep  EEG's  were  recorded  on 
magnetic  tape  and  then  processed  off-line.  All 
the  data  was  obtained  from  the  frontal  position 
(F1-F7)  of  the  skull,  exrept  for  the  awake  data 
(stage  W)  which  was  obtained  from  the  occipital 
region  (03-OZPZ).  The  data  presented  here  were 
obtained  from  a  single  night's  reading  of  a  22 
year  old  male  with  a  relatively  low  amplitude 
EEG. 

The  EEG  data  was  filtered  by  a  lew  pass 
filter  with  an  upper  cut-off  frequency  of  25  Hz 
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and  then  converted  to  digital  data  and  pro¬ 
cessed  with  a  PEP-SI  ccaputer.  The  sampling 
period  was  32  seconds  and  the  sailing  rate  was 
32  sanles/sec. ,  giving  a  maximum  sequency  of 
16.  Inis  sequency  limit  is  close  to  the  tgper 
frequency  liadt  of  interest  in  sleep  EEG  data. 

The  input  data  was  transformed  into  a 
series  of  Walsh  functions  [6]  using  the  Fast 
Bifore  Transform  to  solve  the  equation 

X  -  H  x 

there  x  and  X  axe  1024  element  colimn  vectors 
representing  the  input  end  transferred  data  res¬ 
pectively,  and  H  a  aatrix  generated  by  a  peri¬ 
odic  stapling  of  Walsh  functions  [7] . 

Figure  2(a)  shows  the  amputation  al¬ 
gorithm  employed  to  obtain  the,  Walsh  Transform. 
The  data  processing  differs  from  Pratt  et  al’s 
method  [8]  in  that  the  number  of  blocks,  each 
indicated  by  a  rectangle,  and  the  nuher  of 
data  points  in  each  block  on  a  level  are  first 
calculated  to  obtain  terminal  conditions  for 
the  loops  used  in  computation  of  intermediate 
data  on  next  level.  All  the  intermediate  data 
on  the  next  level  are  then  processed  through 
a  nested  loop  and  the  results  stored  in  separ¬ 
ate  memory  locations.  The  loop  for  computation 
of  intermediate  data  in  odd  blocks  has,  as  a 
unit  operation,  only  the  addition  of  two  data 
while  the  loop  for  even  blocks  consists  of  two 
operations  as  shown  in  Figure  2(b).  For  inter¬ 
mediate  data  storage  an  additional  1024  memory 
locations  are  allocated.  This  amputation  al¬ 
gorithm  has  the  advantage  that  the  Walsh  co¬ 
efficients  are  obtained  in  sequency  order  with 
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fewer  computing  operations.  The  instructions 
needed  for  the  transformation  occupy  only  about 
100  mmeny  locations  and  can  be  applied  to  any 
iuaber  of  input  data  points  which  are  of  two's 
power.  The  transformed  Walsh  coefficient;  were 
squared  and  sinned  pairwise  for  each  seqpency. 
The  spectra  were  converted  to  a  logarithmic 
scale  and  displayed  on  a  storage  oscilloscope, 
from  which  the  Walsh  Spectra:  plots  have  been  ob¬ 
tained. 

The  sane  epochs  were  analyzed  with  a  Gen¬ 
eral  Radio  1921  Real  Time  Analyzer  to  certain 
Fourier  power  spectra  estimates.  The  analyzer 
consists  of  45  filters,  spaced  1/3  octave  apart, 
covering  the  frequency  spectrum  3.5  Hz  to  80k 
Hz.  The  Analyzer  samples  the  outputs  from  the 
filters  to  estimate  the  Fourier  power  spectra. 
The  EEG  was  reproduced  at  32  times  real  speed, 
given  an  equivalent  filter  bandwidth  of  5. 5/32 
Hz  to  2.5k  Hz.  An  integration  time  of  1  second 
was  employed  •  corresponding  to  32  seconds  real 
time.  19  spectral  estimates  in  the  frequency 
range  (.3-19.7  Hz)  have  beet?,  plotted. 

Results  and  Discussion 


Figure  3  shows  typical  Fouvier  spectra  and 
Walsh  spectra  of  each  bleep  stage.  It  is  ob¬ 
served,  in  general,  that  the  Walsh  power  spec¬ 
tra  is  more  diffuse  throughout  the  sequency 
range  than  the  or  rresponding  Fourier  power 
spectra.  The  better  waveform  discrimination  of 
Fourier  power  spectra  for  EEG  activity  of  near¬ 
ly  sinusoidal  form  is  illustrated  in  Figures 
3 (AO)  and  3 (BO).  The  approximately  10  Hz  alpha 
activity  is  observed  in  the  Walsh  spectra  3  (AO) , 
but  sdbhaxsonics  are  more  prominent  than  in  the 
corresponding  Fourier  spectra.  Aliasing  is  not 
believed  to  contribute  to  the  observed  sequency 
diffusion  as  the  Fourier  power  spectra  shows 
relatively  low  EEG  activity  above  16  Hz.  Al¬ 
so,  ten  seconds  epochs  (approximately  100  sam¬ 
ples/sec.)  showed  the  same  frequency  diffusion. 

A  comparison  of  the  plots  for  the  other  sleep 
stages  show  that  the  activities  present  in  the 
frequency  plots  are  also  evident,  in  the  sequency 
plots.  However  the  peeks  are  more  pronounced  in 
the  frequency  plots,  imdoubtedly  due  to  the 
sinusoidal  like  characteristics  of  all  sleep 
stages  except  1  and  1-KFM. 

Lubin  et  al  [2]  have  described  the  ina¬ 
bility  frequency  spectxa  to  discriminate  between 
sleep  stages  using  stepwise  multiple  regression. 
The  same  problem  exists  if  Walsh  spectra  are 
used.  Figure  4  illustrates  the  problem  by  show¬ 
ing  the  similarity  in  the  Walsh  spectra  of  a 
sleep  stage  2  nd  a  sleep  stage  3.  Larsen  and 
Walter  [4]  reported  that  a  multiple  discriminant 
function  analysis  of  frequency  spectra  could 
discriminate  between  sleep  stages  if  an  adequate 
training  sawple  was  ’Bed.  Such  techniques  would 
probably  be  vs  effective  using  Walsh  spectra. 

Similar  characteristics  were  observed  in 
the  comparison  of  the  spec  eras  of  the  other  two 
subjects. 


Figure  2.  Data  Processing  Algorithm. 


Conclusions 

The  discrimination  by  Walsh  power  spectra 
is  not  as  good  as  the  Fourier  spectra  for  sinus¬ 
oidal  like  EEC  data,  but  activity  present  in 
the  frequency  spectra  was  evident  in  the  Walsh 
spectra  plot.  The  Walsh  power  spectral  analy¬ 
sis  has  very  significant  advantages  over  Fourier 
spectral  analysis  in  that  the  foner  requires 
Much  less  coasting  tine  and  computer  memory , 
advantages  which  are  quite  significant  in  a 
laboratory  possessing  a  nini-conputer.  For  in¬ 
vestigators  desiring  to  neks  a  spectral  de¬ 
composition  of  EEG  data,  the  poorer  discrimin¬ 
ation  of  nearly  sinusoidal  waveforms  nay  be 
note  than  compensated  by  the  ease  with  which  the 
Walsh  spectra  can  be  computed. 
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Introduction 

A  main  topic  in  data  transmission  especially 
for  speech  exists  in  pointing&out  optimal  source 
and  channel  coding  [l,2].  The  basic  block  dia¬ 
gram  is  shown  in  figure  1. 


Figure  1.  Basic  communication  system 

The  redundancy  of  the  source  sic  is  sup¬ 
pressed  in  the  source  coder  and  the  reduced 
binary  data  is  protected  against  noise  and  dis¬ 
turbance  in  the  channel  coder.  The  channel  co¬ 
ding  and  decoding  may  be  separately  solved 
and  we  now  consider  a  subsystem  as  shown  in 
figure  2. 


co frt0nt»*4 
Otto 


Figure  2.  Source  coding  and  decoding 

Because  speech  signals  exist  one  part  of  nearly 
periodic  waveforms,  the  voiced  vowels,  and 
on  the  other  hand  of  the  more  unregular  un¬ 
voiced  parts  optimal  coding  must  refer  to  these 
characteristics  in  speech.  This  segmentation 
will  cause  difficulties-especially  the  pitch  de¬ 
tection  problem-and  first  we  make  no  difference 
between  voiced  and  unvoiced  signals. 

Linear  orthogonal  transformation  offers  a  me¬ 
thod  for  data  compression  by  means  of  coding 
the  spectral  coefficients.  The  spectral  distri¬ 
bution  is  exploited  by  different  quantiz-  .  i 
schemes.  These  speech  processing  sys  ..a 
are  also  known  as  orthogonal  transform  voco¬ 
ders  f  3]. 
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Linear  Transformation 

A  time-continuous  frequency  limited  signal  x(t) 
can  be  represented  with  respect  to  the  sampling 
theorem  as  a  discrete  series  of  samples  x(kdt). 
The  discrete  signal  samples  are  written  in  fi¬ 
nite  intervals  as  column  vectors 


Cov(x)=  o' 


1  Pi  P2 

Pi  1  Pj 
2  P2  P1  1 


x(0)=  (x0,Xj,  -.xk..  xN1  )' 

*(1)  = 

&(v)m  (xpN’XpN+r— X(^1)N-1  )( 


and  transformed  with  any  regular  matrix  G 
with  the  elements  g.  on  a  generalized  spec¬ 
tral  domain 

x(p)  =  G  x(i/) 

xXv)  is  the  spectral  vector  of  the  y-th  interval 
and  has  the  elements 

x(i/)  -  (xv  xV  xv  xv  )• 

The  time  dependent  coefficients  may  be  regar¬ 
ded  as  samples  of  convolution  functions  between 
signal  and  the  rows  of  the  transform  matrix  [4]. 
The  inverse  transform  onto  the  original  domain 
is  given  by 

x(p)  =  G-1  x{v) 

There  is  a  one-to-one  correspondence  between 
signal  and  transform  domain  and  no  errors  are 
made  by  linear  transformation  [5], 

Most  signals  are  correlated  because  they  are 
output-functions  of  convolution  type  systems. 
Tnerefore  the  optimum  linear  transformation  is 
given  by  the  Lobve-Karhunen  expansion  because 
the  correlation  between  the  signal  sample."  is 
eliminated  in  the  transform  domain. 

The  statistics  of  the  signal  are  given  in  terms 
of  correlation  coefficients  p.  defined  as 

r  (i) 
xx 

p  .  - 

1  r  (0) 
xx 


and  r  denotes  >hc  autocorrelation  of  the 

XX 

stationary  process,.  The  covariance  matrix  of 
the  process  is  of  Toeplitz  form  and  giver,  by 


o  =  r  (0)  is  the  variance  of  the  process. 

The  Loeve-Karhunen  transform  diagonals -s 
the  covariance  matrix  [6] 

K  Cov(x)  K-1  =  Dlag  (X. ) 

and  eliminates  the  correlation  of  the  process 
in  the  transform  domain.  For  wide-sense 
stationary  processes  and  N  -»  oo  the  covariance- 
matrix  is  diagonalized  by  the  discrete  Fourier 
matrix.  But  for  finite  N  and  non-stationary 
signals  as  short  speech  sample  blocks  the 
optimal  finite  Loeve-Karhunen  transforms  are 
given  by 


JC(v)  Cov  (x(v) )  K(v)‘ 


DiaqQUv)) 


and  will  be  different  in  each  interval.  For  each 
interval  the  Eigenvalues  and  Eigenvectors  must 
be  determined  which  requires  a  large  compu¬ 
tation  time  and  it  is  nearly  impossible  to  per¬ 
form  real-time  processing  of  the  signal.  There 
are  other  methods  f 7 , 8  ]  based  on  a  mean 
Karhunen-Lobve  expansion  where  the  signal  is 
treated  as  a  stationary  process. 

On  the  otherhand  discrete  Walsh  transformation 
offers  new  methods  for  real-time  signal  pro¬ 
cessing  and  digital  hardware  imp’ ^mentation. 
There  exist  fast  transform  algorithms  and  no 
multiplications  are  required  in  Walsh  transforms 
except  sign  changes.  The  correlation  is  not 
completely  removed  in  the  transform  domain 
because  there  are  non-vanishing  elements  out¬ 
side  the  diagonal  of  the  following  transform 


^  W  Coy(a)  W  =  A 


If  the  covariance  matrix  is  a  dyadic  convo¬ 
lution-type  matrix  the  process  is  a  wide-sense 
dyadic-stationary  process  and  the  correlation 
of  the  process  x  is  eliminated  by  linear  Walsh 
transformation  J9]. 

Because  there  are  not  many  non-vanishing  ele¬ 
ments  outside  the  diagonal  we  derive  our  moti¬ 
vation  for  an  application  of  the  Walsh  transform. 


The  discrete  Walr'i  transform  of  the  finite  in¬ 
tervals  with  the  tength  N  =  2n  is  defined  as 

£(t/)  =  W  x(v) 
with  the  inverse  transform 

x(t/) 

W  is  the  N-th  order  Walsh- matrix  and  the  ele- 
meris  w(j,k)  take  only  the  values  +1  and  -1. 

The  matrix  is  orthonormal  [lO,ll] 

W  =  W'  =  N  ijf ! 

Data  compression  is  achieved  when  the  vari¬ 
ances  ir  the  spectral  domain  of  the  special 
signal  to  be  processed  are  known. This  can  be 
done  by  computer  simulation  [l2].  According 
to  the  mean  energy  distribution  G. Robinson  has 
derived  the  bit-assignment  for  the  spectral  co¬ 
efficients  in  a  system  with  N=16  and  proved 
good  results. 

For  the  real-time  signal  processing  with  high 
order  systems  (N-=16  -  1024)  as  required  for 
example  in  image  processing  we  dovelopped 
a  transform  processor  based  on  Walsh  functions, 
other  two-  .alued  and  also  three- valued  functions. 
Analog  ha  dvare  implt  .entations  have  already 
been  discussed  [l3,14].But  using  modern  inte¬ 
grated  MSI  f.r.  i  LSI  circuits  the  system  may  be 
implememe  •  ■  'iih  minimized  expense  and 
highest  flexibility.  In  the  following  chapter  the 
implementation  is  discussed  in  detail. 

Digital  Hardware  Implementation 

Figure  2.  shews  the  basic  diagra-..  of  a  trans¬ 
form  processor. 


reduced  data 


Figure  3.  Basic  diagram  of  a  transform-pro¬ 
cessor. 

The  subsystem  called  spectral  coder  can  also 
be  replaced  by  other  units  for  linear  sni  non¬ 
linear  filtering.  With  a  logarithm  nit  the  sys¬ 
tem  allows  the  double  spectrum  analysis  >n 
the  Walsh  oomain. 


The  transform  and  inverse  transform  subsys¬ 
tems  are  shown  in  figure  4. 


Figure  4. Block  diagram  of  the  transform  units 

Any  arbitrary  waveform  is  frequency  limited 
in  a  low-pass  frequency  filter  with  respect  to 
the  sampling  theorem.  The  discrete  values  at 
times  kdt  are  concerted  into  binary  words  with 
finite  length  p.The  quantized  signal  has  here 
an  input  quantization  error.  The  transform 
of  the  binary  input  signal  yields  N  spectral  co¬ 
efficients.  If  the  word-length  is  p+n  no  additio¬ 
nal  errors  are  made  in  the  transformation  pro¬ 
cess.  The  original  binary  signal  word  is  given 
by  the  inverse  transform  which  is  the  same  as 
the  transform.  The  binary  word  is  shifted  to 
the  right  and  thus  multiplied  with  1/N.The  d/a 
converter  is  producing  an  analog  signal  which 
i  s  the  same  as  the  quantized  input  sir  •  al  ex¬ 
cept  a  time  delay  of  Nat  or  N  samples,  jj 
pass  filtering  yields  a  tine  continuous  fi  eqi 
cy  limited  signal. 

The  total  number  of  required  operations  in  a 
matrix  multiplication  is  N** .  There  exist  fast 
algorithms  called  Fast  Walsh  Transform  S^WT) 
reducing  the  reqirod  operations  to  NlaN=nN 
[  15, 163-  A  transform  onto  sequency  order  d 
spectra  requires  additional  storage  and  the  com 
plete  input  vector  A  transform  onto  se- 

qucncy  order  however  will  be  useful  for  com¬ 
paring  fhe  results  trom  the  well  i.nown  Fourier 
spectrum  direct  with  the  Walsh  spectrum  be- 
•.  ause  there  Is  a  first  order  one-to-one  corres¬ 
pondence  between  sequeney  and  frequency  f  17]. 
Therefore  and  because  oi  more  flexibility  an 
ordinary  matrix  multiplication  processor  has 
been  vorked  out  instead  of  a  fast  transformer. 

The  matrix  multiplies* is  computed  in  N“ 
steps  and  the  transform  vector  is  given  by  *f 
partial  subsums 


x(p-)  =  a 


where  w,  are  the  columns  of  the  Walsh  matrix 
k 


l(t/)=x0w0  +  XjKj  •— *k*k 


Xq»x  ...x„  ^  are  the  elements  of  the  i/-th 
signal  vector. 

A  k-th  partial  sum  of  the  transformation  vec¬ 
tor  is  given  by 


Kiv)  =  ^o,wiLK]  *(t/)k 
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The  Matrix  operations  consist  of  N2sign  changes 
and  additions.  N  operations  are  computed  seri¬ 
ally  in  each  sampling  interval  at.  With  parallel 
binary  arithmetic  the  clock  frequency  of  the 
machine  is  given  by 

f  .  =  Nf  ,  =  — 

clock  sampl.  at 

The  logic  (  TTL  and  MOS)  is  limiting  the  cloc, 

to  f  so  that  ti.e  upper  signal  band  limit 
crnax  a 

is  f 

f  -  cnrnx 
up  2N 

The  implemented  processor  has  a  clock 
quency  of  2  MHz  and  the^ugper  signal  br  - • 
limit  is  15.6kHz  at  N=64.  There  is  no  limit 
for  low  frequencies  and  long  intervals. 

Figute  5.  shows  the  block  diagra;  of  the 
transform  and  inverse  transform  units.  For 
the  binary  representation  we  use  the  two's 
complement  because  there  exists  a  simple  rale 
for  the  multiplication  with  +1  and  -1. 

The  arithme  y  unit  contains  parallel  exor-gates 
adders  and  si  iftrogisters.  We  regard  now  the 
state  k  at  the  thru-  kit  .  The  binary  input  word 
is  multiplied  N-times  with  the  column  vector 
^  of  the  Walsh  matrix.  At  w,  ^=-l?L  the  word 
is  inverted  and  an  L  is  added  'lb  the  last  signi¬ 
ficant  bit.  The  N  products  are  added  to  the 
N  foregoir  1  partial  sums  which  are  stored  in 
the  i'l-stage  shift-register.  The  new  sums 
are  read  into  the  fir.-t  stage  of  the  shift  register 
and  shifted  cyclically  to  tne  right  with  the 


clock  frequency.  After  N(N-l)  operations  the 
input  word  x^  is  multiplied  with  the  last 
column  of  the  Walsh  matrix  ,  added  to  the  sums 
$ .(N-2)  and  at  the  output  of  the  adder  the  Walsh 
coefficients  appear  serially.  In  the  feedback 
between  shiftregister  and  adder  there  are  AND- 
gates  for  the  multiplication  with  zero.  This  is 
required  at  the  beginning  of  each  interval  and 
also  useful  for  the  multiplication  with  the 
three- valued  functions  {-l,0,+l}. 
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Figure  5.  Block  diagram  of  the  arithmetic 
units  of  the  processor 

During  the  last  sampling  interval  (N-l)dt 
tho  coefficients  Sq,x  v.  .  appearing  at  the  output 
of  the  transform  unit  are  read  into  the  shift 
register  of  the  inverse  transform  unit.  This 
register  has  an  intern  recirculation  logic.  In 
each  sampling  interval  the  register  content  is 
shifted  cyclically  to  the  right  and  at  the  output 
of  the  last  stage  the  N  Walsh-coefficients  will 
appear.  The  multiplication  with  the  correspon¬ 
ding  row  of  the  Walsh  matrix  and  summation 
yield  the  original  signal  word  x^.  The  word 
is  now  shifted  n-times  to  the  right  according 
to  the  multiplication  with  1/N,  Because  of  the 
symmetry  of  the  Walsh-matrix  the  signs  for 
transform  and  inverse  transform  are  the  same 
and  only  one  Walsh-generator  is  needed.  We 
have  used  a  proposal  of  Peterson  [l8]. 

The  arithmetic  units  as  shown  above  r  n  be 
also  used  as  digital  Walsh-filters  simply 
modifying  the  register  commands[l9,T0], 
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'Ihe  first  investigations  with  the  transform  pro¬ 
cessor  have  shown  energy  distributions  as 
Uown  in  figure  6. 


Figure  6.  Qualitative  energy  distribution  of 

German  speech  in  the  Walsh-spectrum 

Because  the  absolute  spectral  distribution  is 
constant ,  the  short  time  spectrum  is  differing 
very  much  at  changes  of  the  transform  inter¬ 
vals  from  short  duration  as  2ms  to  long  one 
as  Sms.  But  the  total  energy  of  the  signal  is 
always  constant  in  the  spectral  domain  because 
Parseval’s  theorem  holds  true}  the  areas  under 
the  curves  are  the  same.  The  distribution  will 
also  be  different  for  voiced  and  unvoiced  parts. 
The  distribution  of  figure  6.  is  nearly  the  same 
as  in  the  Fourier  case.  The  voiced  vowels  have 
their  maximum  at  the  absolute  sequencies 
f  =  i/T  **  lkzps  (kilo  zero  crossings  per  sec.) 
which  is  equivalent  to  1kHz  in  the  frequency 
spectrum.  The  unvoiced  parts  have  their  maxi¬ 
mum  at  higher  sequencies  (  3-6  kzps)  f 
ding  to  3-6kHz  in  the  Fourier  spectrum. 

For  N=64  and  T^=8ms  the  energy  distribut.on 
of  the  voiced  parts  has  been  quantized  as 
shown  in  figure  7. 


Tl 


q.  is  the  number  of  bits  for  the  quantization 
of*  each  coefficient.  The  quotient  between  in¬ 
put  bit- rate  (8-bit  PCM)  and  spectrum  rate 
thus  is  given  as  reduction  factor  of 

64kb/s 

r  =  -  =  1,455 

44kb/s 

and  there  was  no  difference  and  loss  in  quality 
between  input  and  outputsignal.  Experiments 
have  also  been  done  with  higher  reduction  up 
to  22kb/s  and  there  was  no  loss  in  int.ellegibili- 
ty  ar.d  only  a  small  amount  of  increasing  quan¬ 
tization  noise  especially  in  the  unvoiced  parts. 
But  this  is  also  clear  because  the  distribution 
of  the  voiced  parts  was  taken.  Further  improve¬ 
ment  will  be  achieved  if  voiced  and  unvoiced 
parts  are  coded  with  different  schemes. 


Pitch-synchronous  Walsh  Transform 

High  data  compression  however  is  only  possible 
if  the  speech  significant  characteristics  are 
turned  out  better.  Thus,  the  bit- rate  of  the 
voiced  qucsiperiodic  vowels  can  be  reduced  far- 
reaching  using  pitch-synchrorous  adaptive  Walsh 
transformation.  The  main  problem  is  the  pitch 
detection,  which  must  be  determined  exactly 
for  reducing  the  variances  in  the  several  spec¬ 
tra.  Figure  8.  shows  the  basic  diagram  of  an 
orthogonal  Walsii-vocoder. 


Figure8.  Basic  diagram  of  an  orthogonal  adap¬ 
tive  Walsh- vocoder 

The  pitch  frequency  is  multiplied  by  N  and  the 
delayed  speech  signal  is  sampled  adaptive  so 
that  such  period  consists  of  N  samples.  The 
sample  frequency  is  also  controlling  the  Walsh 
generator  and  the  arithmetic  unit  .Pi'ch  and 
coefficients  could  be  coded  effective1  y  w'th 
differential  PCM.  The  estimated  bit-rate  might 
be  l-2kb/s.  Th^'i  other  systems  allow  higher 
data  compress  til]  the  advantage  of  the 


Figure  7.  Bit  Assignment  in  the  Walsh-spectrum 


Walsh  transformation  lies  in  the  minimal  elabo¬ 
rateness.  A  photogiaph  of  a  prototype  transform 
processor  is  shown  in  figure  9. 


Figure  9.  Walsh  transform  processor 
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Abstract 

An  experiment  is  described  in 
which  word  recognition  is  based  on 
comparing  th«  \sh  sequency  components 
of  spoken  wo.  with  those  of  a  stored 
library  of  words.  A  Walsh  transform 
computer  program  is  used  to  calculate 
the  sequency  components  of  successive 
segments  of  spoken  words.  The 
components  for  each  word  to  be  recog¬ 
nized  are  arranged  into  an  amplitude  - 
sequency  -  time  matrix  and  correlated 
against  a  set  of  known  test  matrices. 

A  test  matrix  is  generated  for  each 
word  by  averaging  six  matrices  of  the 
word.  By  using  the  highest  correlation 
coefficient  to  determine  which  word 
is  3poken,  recognition  scores  between 
89. 5%  and  100%  are  achieved  for  a  ten 
word  vocabulary  spoken  by  four  speakers. 

Introduction 

In  the  recognition  technique 
described  in  this  paper,  amplitude  - 
sequency*  -  time  matrices  for  ten 
spoken  wor-.s  are  prepared  for  four 
speakers,  and  these  matrices  are 
compared  by  means  of  a  decision  rule. 

A  Walsh  transform  computer  program 
calculates  the  sequency  components  for 
successive  sections  of  each  spoken 
word.  After  the  discrete  Walsh  sequen¬ 
cy  components  of  a  spoken  word  are 
determined,  a  computer  program  arranges 
the  components  into  a  matrix  of 
identifying  numbers.  By  correlating 
the  matrices  with  those  of  a  stored 
library  of  words,  the  spoken  word  is 
identified  by  the  largest  correlation 
coefficient. 


Walsh  Spectral  Analysis  of  Speech 

If  a  segment  of  a  speech  signal 
f(t)  is  represented  by  a  sequence  of 
N  samples,  f(nT),  (krKN-l,  the  discrete 
Walsh  Fourier  or  H&Uamard  transform 
can-  be  defined  as  [2] 

N-l 

W(k)  -  E  f (nT)wal (k,n) ,k*G,l,. . . ,N-1 
n»0  (1) 

where  T  is  the  sampling  < -terval. 
Similarly,  the  inverse  War*.\  transform 

is 

i  N-l 

f(nT)"-—  r  W(k)wal(n,k) ,n»0,l,.. , ,N-1 
Hk-0  (2) 

where  N  is  an  integral  power  of  two. 

The  first  two  discrete  Walsh 
functions  are  defined  as 

wal(0,n)«l,  for  n*0, 1,2,... N-l  (3) 

(1,  fer  nm0 ,1 , 2 , . . .N/2-1 

(4) 

-l,for  n«N/2,  N/2+1, ... »N-1 

The  remainder  of  the  set  of  Walsh 
functions  can  be  generated  by  the 
following  iterative  equation: 

v-al(k,n)*wal(  [k/2]  ,2n)wal(k~2  [k/2]  ,n) 

.  sre  [k/2]  indicates  the  integer  part 
j£  k/2. 

In  this  paper  the  discrete  Walsh 
transform  of  f (nT) ,  0Sn5N-l  is  computed 
on  an  IBM  360/85  by  an  algorithm 
developed  by  Ulman  [3] .  The  algorithm 
provides  the  components  W(k) ,  0<kSN-l, 
in  order  of  sequency. 


The  objective  of  the  pilot  exper¬ 
iment  is  to  recognize  a  limited 
vocabulary  of  words  and  to  take  advan¬ 
tage  of  the  speed  of  the  Wa Lah  trans¬ 
form  which  requires  only  real  time 
additions  and  subtractions. 


*Harmuth  [1]  has  defined  sequency 
to  be  one  half  the  average  number  of 
zero  crossings  per  second  of  a  function 
and  has  abbreviated  sequency  as  "zps" 
in  analogy  to  cycles  per  second. 


If  the  even  and  odd  discrete  Walsh 
components  in  (1)  are  confoined,  a 
power  spectrum  can  be  computed  as 
follows  [1,4]: 

fw2(0)  ,k»0 

POO-J  ,  ,  (5) 

(w2(2k)+W2  i-  ) ,k»l,2, ... , N/2-1 

The  computaixons  in  <1)  end  (5) 
provide  only  one  spectral  section,  that 
is,  the  sequency  components  at  a  time 
t»'N-l)T.  To  obtain  a  short-time 
spevtral  analysis,  we  compute  (1)  and 
(5)  at  successive  instants  of  time  and 
essentially  determine  a  running  Walsh 
spectrum  fer  each  spoken  word. 
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Hence 


Hr(JO 

and 

Sr(k) 


N-l 

-  I  f  (nT+rMT)wal(k,n)Jc-0, 
n»0 

(w|  (0)  ,k*0 

(w2  (2k)+W|(2k-l),k-l,2, 


.  ,N-1 
(6) 
(7) 

.,N/2-l 


The  two  eets  of  numbers  wr(k)  and 
S  (k)  represent  the  discrete  Walsh 
transform  and  power  spectrum, 
respectively,  of  a  section  of  a 
speech  signal  starting  at  t-*rMT  and 
ending  at  t*rMT+(N-l)T.  Successive 
sections  are  spaced  in  time  by 
MT  t5j. 

A  normalized  spectrum,  Qr(k),  is 
calculated  from  (7)  for  each  word 
by  finding  the  maximum  value  of  Sr(k) 
for  each  utterance  and  modifying 
(7)  as 

sr'max 

Or.(k)-*-10  log  -  ,k«0,l, . . .N/2-1 

Sr(k>  i8) 

All  values  of  Q  (k)  below  -30db  are 
set  equal  to  -30db.  Hence 


For  each  utterance,  a  test  matrix 
is  generated  by  averaging  six  matrices 
of  the  same  word.  Thus  there  are  ten 
test  matrices  for  each  speaker.  The 
words  to  be  recognized  for  a  particular 
speaker  are  compared  with  each  of  the 
speaker’s  test  matrices. 
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matrix  cell 


Time 


/-30db  if  Q_(k)  *-30db 
P_{k)-  i  r  (9) 

(p  {k)  if  Qr(k)>-30db 


Figure  1.  Example  of  the  coordinates 
of  the  amplitude  -  sequency 
-  time  matrix 


Each  word  is  represented  by  an 
amplitude  -  sequency  -  time  matrix 
whose  values  are  between  0  and  -30db. 

General  Procedure 

The  spoken  digits,  one  through 
ten  are  low-paaa  filtered  to  4kHz, 
sampled  at  10kHz  by  a  12  bit  PCM 
coder,  and  recorded  on  a  digital 
tape.  The  digital  tape  is  edited 
so  as  to  produce  «ix  records,  each 
containing  1C24  sample  data  points, 
or  6x1024*6144  samples  for  each 
spoken  word. 

The  utterances  on  the  digital 
tape  are  processed  by  the  Walsh 
spectrum  analyzer  described  by  (6)  to 
id).  The  sets  of  numbers  Pr(k)  for 
successive  eet.ions  of  each  word  are 
arranged  in  the  computer  as  a  data 
matrix  with  the  format  shown  in 
Figure  1.  The  columns  of  the  matrix 
correspond  to  successive  segments  of 
a  word,  where  each  segment  starts  at 
time  t*rOT  and  ends  at  time  t-rMT 
+(n-l)T.  The  rows  are  the  sequency 
components  Prtk),  Q<k<N/2-l,  which 
correspond  to  each  word  segment. 

Such  a  matrix  may  be  regarded  as  a 
digital  spectrogram  (5,6). 


Let  C(i, j)  represent  a  matrix 
cell  in  a  word  to  be  recognized,  where 
i  is  the  index  for  the  sequency  compo¬ 
nents  and  j  is  the  index  for  successive 
time  sections.  A  correlation  coefficient 
can  be  generated  for  the  two  matrices 
as  follows  [7] : 


P 


N/2  L 

Z  Z  C(i,j)  D(i,j) 


i-1  j-1 


n/2 

Z 

i-1 


L 

Z 

j-1 


C2(i,j) 


N/2 

Z 

i— 1 


L 

Z 

j-1 


•(10)  . 


D2(i,j> 


N/2  is  the  number  of  components  in 
the  Walsh  power  spectrum  and  L  is 
the  total  number  of  successive  time 
segments.  By  generating  a  correlation 
coefficient  between  the  unknown  word 
and  each  of  the  test  matrices,  a 
decision  can  be  made  on  the  basis  of 
the  best  correlation  coefficient. 


Experiments!  Procedure 

Three  experiments  were  performed. 
For  the  first  and  second  experiments, 
the  parameter  N  in  (6)  to  (10)  was 
chosen  as  128.  This  means  that  sep¬ 
aration  between  successive  spectral 
samples  was  78.125  zps  (sp3  is  one- 
half  the  average  number  of  zero 


First  Experiment 

No.  of  sequency  components=N/2»64 
No.  of  spectral  sections»J>48 

Recognition  Scores 

Approximate 
Computer  Time 

First 

male 

speaker 

Second 

male 

speaker 

Third 

male 

speaker 

Female 

speaker 

Generation 
of  spectral 
components 

r 

Corre¬ 

lation 

96.6% 

94.9% 

100.0% 

93.3% 

80  sec 

34 

sec 

Seco  '  Experiment 

Lower  order  components  used 

No.  of  sequency  components*N/4«32 
No.  of  spectral  sections*L=48 

93.3% 

93.3% 

96.6% 

91.6% 

80  sec 

21 

sec 

Third  Experiment 

No.  of  sequency  components*N/2*32 
No.  of  spectral  seetions-L*96 

96.6% 

94.9% 

100.0% 

89.9% 

112  sec 

42 

sec 

Table  1.  Recognition  scores  for  four  speakers  and  approximate  computer  time 
required  to  generate,  correlate,  and  recognize  words. 


crossings  per  second  [1])«  The  para¬ 
meter  M  was  chosen  as  128  in  (6)  to  (9) . 
With  the  sampling  interval  T*6.1  ms, 
M«128  corresponds  to  obtaining 
spectral  sections  every  HT»12.8  ms. 
since  each  utterance  consists  of  6144 
sample  data  points,  there  were  48 
spectral  sections  for  each  spoken 
word.  Hence  I,  in  (10)  was  48. 


sets  were  used  to  form  the  test  matrices. 
Matrices  for  the  second  six  sets  were 
compared  against  the  test  sets.  The 
recognition  rates  which  varied  from 
89.9%  to  100%  are  shown  in  Table  1. 

Table  1  also  shows  the  approximate 
computer  time  necessary  to  generate 
and  correlate  the  spectral  components 
for  each  experiment. 


In  the  first  experiment  the 
successive  spectral  sections ,  Pr (k) , 
OfkjN/2-1,  contained  64  components. 
Bach  word  to  be  recognized  was  repre¬ 
sented  by  a  64x48  amplitude  -  sequency 
-  time  matrix  and  correlated  against 
each  of  the  64x48  test  matrices. 

In  the  second  experiment  only 
the  lower  order  sequency  components, 

P  (k) ,  0<k&31,  were  used.  Each  word 
was  represented  by  a  32x48  matrix 
and  correlated  against  each  of  the 
32x48  test  matrices.  The  results 
of  the  first  and  second  experiments 
are  shown  in  Table  1. 

For  the  third  experiment  the 
parameter  N  in  (6)  to  (10)  was  chosen 
as  64,  and  the  separation  between 
sequency  samples  was  156.25  zps. 

By  choosing  M>64,  ve  obtained  96 
spectral  sections,  where  the  sections 
were  separated  by  MT»6 . 4  ms.  The 
successive  spectral  sections ,  Pr (k) , 
0<ksN/2-l,  contained  32  components. 
Each  word  was  represented  by  a  32x96 
matrix  and  correlated  against  each 
of  the  32x96  test  matrices.  The 
results  of  the  third  experiment  are 
also  shown  in  Table  1. 

Experimental  Results 

Twelve  sets  of  the  numbers  one 
to  ten  were  spoken  by  three  male  and 
one  female  speaker.  The  first  six 


In  the  second  experiment  an 
attempt  was  made  to  reduce  the  computer 
computation  time  and  storage  requirement 
by  using  the  lower  order  sequency 
components.  Since  the  results  do  not 
vary  significantly  from  thone  of  the 
first  experiment,  it  appears  that  we 
were  able  to  achieve  data  reduction. 

This  is  similar  to  the  results  obtained 
by  Pratt,  Kane,  and  Andrews  [8]  who 
were  able  to  achieve  bandwidth  reduction 
by  ignoring  the  higher  order  sequency 
components . 

In  experiment  number  three  the 
sequency  components  were  further  ay-art . 
The  recognition  scores  of  the  first  and 
third  experiments  were  similar  except 
for  the  female  speaker,  but  more 
computer  time  was  required  for  the  third 
experiment.  Therefore,  the  first 
experiment  produced  satisfactory 
overall  results. 

Discussion 

Because  the  Walsh  transform 
requires  less  computer  time  than  the 
Fourier  transform,  the  Walsh  transform 
was  chosen  for  the  recognition 
experiments.  The  Walsh  transf  rm 
requires  only  real  additions  and  sub* 
tractions  whereas  the  Fourier  transform 
requires  complex  .multiplications, 
additions,  and  subtractions.  Pratt, 
Kane,  and  Andrews  [8)  were  ''ble  to 
realize  a  reduction  in  time  b.f  a 
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factor  of  6.6  by  using  the  Walsh 
transfora. 

Hence  the  objective  of  this 
experiment  was  to  recognize  words  with 
a  minimim  amount  of  computer  tine  and 
storage  by  correlating  Walsh  spectrums. 
It  required  approximately  80  to  112 
seconds  of  computer  time  on  an  IBM 
360/85  to  generate  matrices  for  twelve 
sets  of  10  spoken  words.  It  also 
required  approximately  21  to  42 
seconds  to  generate  the  test  matrices 
and  perform  the  recognition  procedure. 

The  Major  disadvantage  of  the 
system  was  its  inability  to  cope 
with  the  variations  of  the  duration 
of  the  spectral  events  which  constitute 
words.  This  problem  was  partially 
solved  by  using  test  matrices  which 
were  the  average  of  six  matrices. 
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Abatraet 

A  novel  circuit  for  generating  tba  firat  6U 
Welsh  fwotlona  with  no  timing  error,  haaard- 
free,  and  aynchrrnitirg  pulaee  for  the  tine 
period  0  la  ex^l-Uned,  The  circuit  requires  a 
minimal  amount  oi  hardware,  and  can  be  operated 
at  high  apeeda.  Ita  use  in  an  inverse  Walsh 
Transfora  apparatus  for  displaying  video  data  is 
covered. 

Introduction 


during  the  period  0,  and  exact  knowledge  of  the 
beginning  of  the  tune  period  0,  along  with  high 
frequency  operation,  and  a  simple  circuit  are 
required.  The  circuit  proposed  here  aoeem- 
pliehes  all  these  alas,  and  is  also  programmable. 
The  input  of  a  standard  binary  oods  for  the 
Walsh  number  I  (between  0  and  6ii)  will  determine 
which  function  is  generated.  Because  of  the 
relationship  between  the  SAL  and  CAL  functions, 
and  the  Walsh  functions  (WAL)  the  circuit  can 
also  generate  thooo. 


The  project  outlined  here  was  undertaken  when 
an  interest  was  shown  in  using  Walsh  functions 
for  lnage  transformation  by  soae  authors  (1,2). 
The  possibility  of  transmit ting  the  image  in  the 
transform  domain,  and  than  reconetracting  it  at 
the  reoaiver  offered  the  possibility  of  a  lower 
bit-rate  transfer  of  data,  and  bsnoa  the  possi¬ 
bility  of  bandwidth  reduction.  In  order  to  use 
this  transform  eoonoadcally,  inexpensive  hard¬ 
ware  had  to  be  developed  which  would  work  at  the 
high  speeds  deaundsd  by  video  proposal  ng  for 
reel-ties  applications.  The  results  outlined 
below  are  the  result  of  an  initial  investigation 
into  such  hardware. 

Walsh  generator  Design 

The  typical  Walsh  function  generator  uses 
exduaivs-or  (3,l»,5)  or  exclusive -nor  gate*  (6), 
to  produce  the  appropriate  Walsh  functions. 
OeeeraUy  thaaa  are  based  on  combinations  of 
Radsmacher  functions.  One  design  requires  the 
use  of  discrete  reairtor-capacitor  oewponeats 
(7)  to  produce  the  final  function  output.  A 
recent,  circuit  (8)  has  th*  advantage  of  being 
able  to  determine  the  exact  value  of  the  Walsh 
function  at  any  point  in  the  time  interval  0. 
Eawpt  for  the  circuit  of  (8)  these  hardware 
generators  produce  a  variable  time.’ delay  in  gen¬ 
erating  tba  higher  sequs vwy  fmetiona,  siaoa  the 
generation  of  the  higher  sequency  terms  depends 
on  th*  generation  of  one  or  more  of  the  lowar 
sequency  functions.  When  attempting  to  reproduce 
time  varying  functions  fJroa  their  Walsh  domain 
coefficients,  tfeUu  timing  error  may  be  critical, 
particularly  at  high  frequencies. 

Frestest  techniques  also  have  a  tendency  to 
produo*  so-called  "hasards",  nr  stray  paisas, 
simply  bseasae  of  th*  inherent  techniques  used 
in  generating  the  function*.  These  hasards  am 
most  notable  whae  generating  funotions  using 
exclusive -o?  gates  and  previously  gensratod 
(eras.  In  order  to  produce  a  better  circuit  for 
generating  these  function#,  the  problems  of 
hasards,  accurate  timing  of  the  soro-croasing 


The  selected  Waleh  function  is  gauarsted  for 
the  entire  period  0.  A  "SYNC"  poise  is  pro¬ 
duced  at  the  beginning  or  and  of  the  time  period 
0.  Tbs  circuit  la  shown  in  Fig,  1. 


Fig.  It  A  6-bit  Frogrwmmbla  Welsh 
Function  Generator, 

Th*  Walsh  Barbers  arm  entered  using  the 
weighting  show  on  the  W  input  lines.  For  ex¬ 
ample,  WAL(9,0)  would  be  obtained  by  entering 
the  following  binary  oode: 

W32  *16  W8  Vk  V2  W1 
0  0  1  0  0  1 

Thie  binary  oode  ie  gated  by  AMD  gates  coupled 
to  a  6-bit  binary  down  counter,  and  the  clock 
input.  By  using  a  narrow  clock  pulse,  the  clr» 
cult  can  predooe  a  poles  train  depending  oh  the 
state  of  the  oounter.  In  effect,  the  aero- 
crossings  of  the  Radamacher  function-  are  dsteot- 
sd  and  the  appropriate  ones  are  used  to  toggle 
a  final  flip-flop.  Because  the  output  is  taken 
from  *  mamory  element  (the  final  flip-flop),  its 

*  Patent  applied  for,  January,  1970. 
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output  state  is  bold  at  a  fixed  lsvml  until  tbs 
naxt  clock  pula*  la  permitted  to  toggle  the 
memory.  Accordingly,  tranaitiona  within  the 
circuit  do  not  appear  at  the  output,  and  the 
"hasard"  problem  is  evsrcosm,  Because  the  out¬ 
put  is  tied  to  the  clock  frequency,  changes  of  t 
the  output  always  occur  at  "clcci"  tinea,  and 
hence  there  is  no  rippling  through  of  the  final 
«nner .  The  circuit  was  also  designed  to  he 
fully  iterative  (i.e.  each  stage  in  the  main 
circuit  is  identical,  allowing  for  a  Jimpla 
addition  or  delation  of  stages  depending  on  the 
amber  of  Welch  series  required).  Iterative 
design,  however,  does  out  down  on  the  speed  of 
operation  of  the  circuit.  If  a  fully  synchron¬ 
ous  circuit  were  used  for  the  counter,  very 
high  speed  oould  be  built.  With  standard  logic 
nodules  ( eerie s  51*  or  71*  TIL  logic),  the  circuit 
would  work  up  to  lONb. 

Tbs  circuit  also  gnwatee  a  "STUB*  pulse  at 
the  of  the  tins  period  9  which  is 

effectiwly  used  in  the  high  speed  transform 
apparatus  described  later  to  transfer  data  frcn 
a  buffer  register  (coupled  to  a  computer  or 
manual  switches)  to  ths  register  holding  the 
coefficient  miser  WAL(N,9).  Henos  the  data 
presented  on  the  V  lines  of  Fig.  1  is  held  for 
the  entire  time  period  9,  and  is  only  updated 
at  the  beginning  of  the  period.  The  buffer 
register  can  be  easily  loaded  while  the  main 
generator  is  producing  the  actual  functions. 

Series  Expansion  by  Walsh  Functions 

Any  periodic  function  f (t)  can  be  expanded  in 
a  series  of  the  orthogonal  system  of  Walsh  func¬ 
tions  WAL(*,t)  in  tbs  interval  of  orthogonality 
T.  Qy  making  9  -  fc/T,  the  system  will  be  norm¬ 
alised,  and  the  expansion  of  f(9)  will  be  given 
as:  «• 

f  (9)  «  2ij  AyWAL(M,9)  (1) 

*-  0  " 

for  0  5  9  <  1 

The  coefficients  iL.  of  the  series  expansion 
can  be  obtained  by  multiplying  equation  (1)  by 
WAL(J,9),  and  integrating  the  products  over  the 
period  of  orthogonality  using  the  orthogonality 
relationships 

^  WAL(M,9)WAL(j,9)d9  -  (2) 

0 

where  SNj  ■  1  for  N  -  j 

-  0  for  !f  /  J 
th 

Hence  the  i  coefficient  Is  given  by 

a.  -  £r<9)wAL<i,e)de  (3) 

1  0 

The  series  expansion  of  f (9)  can  be  expressed  in 
terms  of  tbs  even  and  odd  Walsh  functions  CAL(i,9) 
and  SAL(i,9)  as 

f<9)  -  aQ  +  JtajCAKM)  ♦  ^811(1,9)]  (1*) 


*0  -  ^  f(9)d9 
1 

a.  »  5  f(9)CAL(i,9)d9 

0 

1 

b.  -  S  f(9)SAL(i,9)d9 

0 


Ths  first  few  Welsh  functions  and  their  re¬ 
lation  to  the  SAL  and  CAL  functions  are  shown  in 
Fig.  2. 
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Fig.  2:  The  first  16  Walsh  Functions. 


Aaolitade  Sampling  and  Walah-Fourier  AnaljrTris 

The  easpling  theorem  of  Fourier  analysis 
states  that  a  signal  band  limited  to  B  Us  is 
oomplately  determined  by  2B  amplitude  samples 
per  second.  This  theory  is  also  true  for  Walsh- 
Fourier  analysis. 

Let  a  signal  f(t),  band  limited  to  B  He.,  be 
represented  by  amplitude  samples  token  at  a  rate 
equal  to  2B  samples  per  second,  if  the  period 
for  the  time  base  Is  taken  aj  T  such  that  2BT 
is  equal  to  2°  ■  Jf  (the  number  of  samples  of  the 
signal  f(t)  ),  and  making  9  *  t /T,  than  the  ex¬ 
pansion  of  the  signal  f(t)  in  a  normalised  Walsh 
series  will  has 

f(9)  .  J^M.VhL(±,9)  QstKL  (5) 

i-0  1 

Ths  coefficients  will  be  given  by  equation  (3). 
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From  the  ikw  symasetry  property  of  Welsh  func¬ 
tion.*,  the  Walsh-,  ourisr  coefficients  a.  for  1 
i  »!  will  vanish,  Thin  Mans  that  ths  nAxlaum 
eequancy  contained  in  the  aignai  f(t)  in  the  in¬ 
terval  T  is  (2BI-1).  This  will  be  the  upper 
limit  in  the  auaaaxtion  of  equation  (5),  and  the 
discrete  transform  becomes i 
N-l 

f(9)  -  Enw«<U»»)  (6) 

i-0  x 

In  other  words,  the  maximum  eequency  of  the 
signal  f(t)  ia  B  aero  crossings  per  second.  By 
representing  f(0)  by  N  samples  in  the  interval 
0  <  9  <  1,  the  Integration  of  equation  (3)  for 
determining  the  coefficients  can  be  changed  to 
a  summation  by  dividing  the  period  0  into  N  sub¬ 
intervals  of  length  1/N.  Then  the  coefficients 
are  given  by: 

.  N-l 

a.  -  g  2  f(8)WAL(i,9)  (7) 

1  9-0 

i  ■  0,1,...,N-1, 

These  equations  can  be  implemented  to  perform 
the  Fast  Walsh  Transform,  and  the  coefficients  a 
obtained. 

The  Instrument  Design 

The  fundamental  limitation  of  the  Walsh  Func¬ 
tion  generator  described  earlier  to  be  program¬ 
mable  to  obtain  the  flrot  61*  coefficients  limits 
the  number  of  samples  N  to  61*.  The  inatrument 
was  designed  to  operate  with  dominant  term  syn¬ 
thesis,  and  a  eeloctlon  of  the  dominant  16  terms 
from  the  field  of  61*  is  used  in  the  final  design. 

The  inatrument  was  designed  to  perform  the 
inverse  transform  (effectively  equation  (6))  but 
only  using  dominant  terms.  The  main  objective 
of  the  circuit  was  to  directly  drive  s  television 
screen  to  display  video  data  being  generated  in 
the  Walsh  domain.  The  long  term  objective  of  the 
work  was  to  Investigate  bandwidth  reduction 
schemes  by  transforming  an  original  imago  to  the 
Walsh  domain,  transmitting  significant  terms, 
md  then  reconstructing  the  image  at  the  receiv¬ 
er. 

The  general  circuit  for  the  hardware  implemen¬ 
tation  is  shown  in  Fig.  3,  whore  only  eight 
terus  are  ehown  being  generated.  The  circuit,  it 
duplicated  and  sunned  In  the  final  adder  in  order 
to  obtain  the  16  term  synthesis  described.  The 
final  circuitry  was  analog  in  nature  in  order  to 
maintain  speeds  around  1  to  10  MHz ,  and  used 
IC  analog  multipliers  to  perform  the  arithmetic. 
The  coefficients  a.  are  converted  to  analog  form 
by  D/A  corr'erters,  and  the  output  of  the  Walsh 
function  generator  directly  drives  the  othar 
terminal  of  the  multiplier.  The  output  of  each 
naltl pile r  la,  in  effect,  an  amplitude  modulated 
Welsh  function.  The  outputs  of  the  multiplier 
are  added  using  a  standard  operational  amplifier 
adder,  and  the  final  output  drives  a  CRT  inten¬ 
sity  grid. 

A  synchronizing  pulse  is  used  to  lock  the 
horizontal  sweep  generator  to  the  standard 
video  fra*  sync.  Fig,  I*  shows  the  teet  oircult 
apparatus,  with  a  manually  preset  signal  being 


generated  continuously  acroaa  tbs  screen.  The 
time  period  0  was  taken  a a  ^  of  the  screen 
trace  time. 


Fig.  3 i  Inverse  Transform  Basic  Circuit. 


Fig.  1*<  Test  Apparatus  and  Inveroe  Transform 
Instrument, 


i'-iV  *5* 


Rooe It*  and  Conolusiono 

Torn  system  hu  been  constructed  and  tested 
for  manual  input  of  dote.  Ida*  traces  of  a 
typical  television  display-  have  boon  analysed 
to  obtain  tba  Walsh  coefficients  a,,  and  these 
bar*  boon  Implemented  on  tbo  inotrfeent  in 
ordor  to  measure  orron. 

Saao  tontativo  ro  stats  on  using  noro  bits 
to  specify  tho  dominant  coefficients,  and  fever 
bits  to  represent  tho  saaller  eooffioionto,  as 
wall  as  dominant  tores  solootion  hare  shown 
that  bit-rates  of  2.2  to  3  bits/oooffioisnt, 
and  using  61t  eooffioionto  to  ropresont  a  H"« 
(four  updates  of  2 6  oooffioients  each)  produos 
a  reasonable  reconstruction. 

Further  work  io  in  progress  in  dividing  <ise 
lino  into  8  intervals,  and  interfacing  the 
InstruMUt  to  a  computer,  for  direct  control  of 
the  video  display. 

The  Instrument  is  designed  to  reconstruct 
video  signals,  based  on  dominant  ten  synthesis, 
and  hence  the  need  for  a  programmable  Walsh 
function  generator  that  will  work  at  theee  high 

speeds. 

References 

1.  W.K.  foot*,  J.  Kane,  H.C.  Andrews,  "Hadamard 

Tranefore  Image  Coding",  Proc.  IBB,  Vol. 

57,  Ho.  1,  pp.56-58,  Jan.,  1969. 

2.  T.S.  Huang,  W.F.  Sofareibar,  O.J.  Tretiak, 

"Image  Processing",  Proc.  D»,  Vol.  59,  *0. 

11,  Hot.  1971. 


3.  Hareoth,  H. ,  Tranrel  nslon  of  Information  by 
te^gonal functions.  Springer-Varlas.  Bor- 

kt  I.A.  Davidson,  "The  Uae  of  Valah  Functions 
for  Multiplexing  Signals",  Proc.  Syep.  Appl. 
Walsh  Functions,  Washington,  1970,  pp.  23- 

25. 

5.  K.H.  Siemens,  R.  Kitai,  "Digital  Walsh- 
Fourier  Analysis  of  Periodic  Vaveforee", 

IBS  Trane,  on  Instnmi entation  and  Measure- 
rente,  ZM-l8,Mo.  It,  pp.  316-321,  Deo.  1969. 

6.  S.M.  Mangli,  "Welsh  Funtion  Oent  rater", 

Proc,  OS,  Vol.  59,  Ho.  1,  pp.  93-9U,  Jan. 
1971. 

7.  F.J.  Iebert,  "Walsh  Function  Generator  for 
a  Million  Different  Functions",  Proc.  3y*p. 
Appl.  Valhh  Functions,  Washington.  1970, 

PP.  52-51*. 

8.  R.  Kitai,  K.  Si— ere,  "A  Hasard-FXwe  Walsh 
Function  Oenerator",  Trans.  Inst,  and 
Haaaurerents,  pp.  80-83,  Feb.  3972. 
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Abstract  Generation  of  Hadamard  Functions 


The  sequence  of  ♦l's  and  -l's  of  any  Kad- 
amard  function  can  be  deduced  from  its  binary 
index.  The  factorization  of  a  Hadamard  matrix 
is  derived  similarly.  An  "in  place"  Fortran 
subroutine  to  compute  the  Hadamard  transform 
of  a  real  signal  is  developed. 

Hadamard  Matrices 


Each  row  of  a  Hadamard  matrix  corresponds 
to  a  Hadamard  function  had  (j,k),  for 
j  »  0,1,2,....,N-1.  It  is  well  known  that 
these  functions  may  be  generated  through  the 
first  m  Radcmacher  functions  [1] .  For  example, 
with  N  *  23,  the  values  of  the  Rademachar 


functions,  namely  r  ,  r.  and  r,,  for 
...,7,  are  as  illustrated  in  Fig.  1. 


for  k«0,l,2. . 


The  Hadamard  matrix  is  a  square  array  of 
plus  and  minus  ones,  whose  rows  and  columns 
are  orthogonal  to  each  other  (i.o.,  the  product 
of  the  matrix  and  its  transpose  is  the  identity 
matrix  times  a  constant  N).  N  is  the  order 
of  the  matrix,  and  the  lowest  value  it  may 
assume  is  two,  thus  giving  the  lowest  ordered 
Hadamard  matrix  as 


H 


2 


1  1 
1  -1 


(1) 


k  0 

1 

2 

3 

4 

5 

6  7 

ro  1 

1 

1 

1 

- 

- 

-  - 

rl  1 

1 

- 

- 

1 

1 

-  - 

r2  1 

- 

1 

- 

1 

- 

1  - 

Fig. 

1: 

Rademacher 

Functions 

For  this  example,  j  can  be  expressed  in  a 
binary  notation  as 


Hadamard  matrices  of  higher  order,  for  N 
a  power  of  two,  may  be  generated  by  a  Kron- 
ecker  product  operation,  such  that 


It 


2N 


"N  "n 

>  -,IN 


(2) 


j  -  4b4  ♦  2b2  ♦  bj  (5) 

for  b^  m  0  or  1, 
i  *  1,  2,  4  . 

Fig.  2  shows  all  the  possible  values  of  j. 


For  example. 


j  b4  b,  bj 


h2  h2 


H4  “ll4j 


11111111 
1  -  1  -  1  -  1  - 

11--11-- 
1  -  -  1  1  -  -  1 

1111 - 

1  -  1  -  -  1  -  1 

1  1  -  -  -  -  1  1 

1  -  -  1-11- 


(4) 


L  2 

-H2 

n 

0 

1 

0 

1  J 

1  1 

3 

0 

1 

i 

1  - 
1  1 

1  - 

(3) 

4 

1 

0 

0 

1  - 

-  1 

5 

1 

0 

1 

h 

H4 

6 

1 

1 

0 

7  111 

Fig.  2:  Binary  Equivalent  of  j 

The  correct  combination  of  r0,  rj  and  r2,  to 
produce  had  (j,k)  is  given  by  the  binary  l'» 
under  columns  b4,  b2  and  bj  respectively,  as 
shown  in  Fig.  2.  For  bj  ••  0,  the  correspond¬ 
ing  Uademachcr  function  i;  not  involved  as  a 
multiplying  factor  and,  in  its  place,  for  all 
values  of k ,  a  value  of  1  is  assumed. 


From  the  binary  equivalent  of  j ,  the  entire 
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sequence  of  +l's  and  -l's  for  any  Hadamard 
function  had(j,k)  can  be  deduced  [2],  The  ini¬ 
tial  value  of  this  sequence  is  +1  as  had(j,0)is 
equal  to  1.  The  length  of  the  sequence  is 
deternined  by  the  number  of  binary  digits  in  j 
such  that,  for  every  b^,  the  sequence  is  to  be 
extended  to  the  right  by  i  bits.  The  binary 
nature  of  this  system  means  that  this  extension 
can  bo  achieved  simply  by  doubling  its  original 
length.  Accordingly,  the  bits  to  be  examined 


successively  are  bj,  t>2. 


.... ,bM 


As  mentioned  earlier,  if  bj  =  0,  a  multi¬ 
plying  factor  of  <-l  is  assumed.  Consequently, 
the  original  string  of  ♦l’s  and  -l's  is  to  be 
copied  once  more  to  the  right.  On  the  other 
hand,  if  «  1,  the  corresponding  Rademacher 
function  is  involved  in  the  product.  Its  value 
is  equal  to  +1  for  k  =  0,1,...,  i-1,  but  -1 
for  k  =  i,  i+1,  .....  2i-l.  Hence  the  sequence 
is  to  be  expanded  by  adding  on  the  complement 
of  the  existing  string  of  +l's  and  -l's.  The 
formulation  of  had(j ,k) ,  where  j  c  1 01  in 
binary  form,  is  illustrated  in  Fig.  3.  This 
simple  technique  to  generat  any  Hadamard 
function  through  its  binary  indexing  is  valid 
as  long  as  the  length  of  the  sequence  is  a  power 
of  two .  % 

Hadamard  function  had(j.k)  of  length  N=211 
tet  j  *  bj  ♦  2b2  ♦  ....♦ibj  ♦  .... 

where  b.  «  0  or  1 , 

i  «  1,2,4, .....N/2. 

For  every  b. ,  extend  the  sequence  of 
♦l's  and  -l*s  to  twice  its  length  by 
adding  the  sequence  on  the  right  under 
the  following  rules: 

1)  the  same  sequence  if  bj  »  0, 

2)  the  complement  of  the  sequence 
if  b*  =■  1. 

For  example,  with  N=8, 
bj  ♦  2b2  ♦  4b^ 

had(S.k)  =  had(101,k) 

Sequence 

initial  value 
b.  *  1 

L  -  b,  »  0 

.  -  -  1  -  1  b‘  «  I 

Fig.  3:  Generation  of  a  Hadamard  Function 
Through  Binary  Indexing 

Hadamard  Transform  of  a  Real  Signal 

The  Hadamard  transform  ,f  a  real  signal 
may  be  defined  as 
.  N-l 

F(j)  “  jr  l  f(k)  .  had(j.k)  (6) 

k*0 

where  F(j)  »  j**1  normalized  Hadamard  coefficient, 
f(k)  «  discrete  samples  of  the  signal, 
had(j,k)  »  j1*1  Hadamard  function. 


The  inverse  Hadamard  transform  is  given  by 
N-l 

f(k)  *  J  F(j) »  had(k.j)  (7) 

j=0 

Since  the  Hadamard  matrix  is  orthogonal, 

had(j,k)  *  had(k.j)  (8) 

Equations  (6)  and  (7)  are  analogous,  except 
for  the  factor  N.  Consequently  the  procedure 
to  compute  the  Hadamard  transform  end  the 
inverse  process  are  basically  the  same. 

Equation  (6)  may  be  expressed  in  an  iter¬ 
ative  form,  thereby  improving  computational 
efficiency.  For  simplicity  of  explanation, 
consider  the  case  when  N=8.  Then  j  and  k  may 
be  represented  by  the  following  binary  equiv¬ 
alents  : 


*  2j 


2  +  h 


4kj  ♦  2k2  +  kj 


wl  ire  j . ,  k .  =  0  or  1  • 

Ji’  x 

The'  \i  damard  function  may  be  completely 
facte r- ted  [3,4]  into 

had(j.x)  =  (-i)Jlkl  (-l)j2k2  (-llj4k4  (11) 

Equation  (6)  m?y  now  be  rewritten  in  an  itera¬ 
tive  form  [3,4] 

F{j4,j2,ji)  -  J  £  (-l)jlkl  l  (-l)j2k2 
k^O  k,=0 

.  |  (-l)k4^4  f(k  k ,,k.)  (12) 

k.  ”0  1 

4. 

The  array  from  £  (-l)k4'4  f(k4,k2,k1)  becomes 

k4»0 

the  data  array  for  the  next  stage  of  computation 
each  of  which  requires  N/2  additions  and  N/2 
subtractions.  Eventually  the  Hadamard  coeffi- 

k  f(k)  - -  C—Ultfcn  dtftdtort  F(J)  I 


wmm 


Fig.  4:  Signal  Flow  Graph  for  Fast 
Hadamard  Transform 


./  "rU 


For  example,  vith  i  =  4: 


cients  will  be  produced  in  their  correct  order 
without  any  shuffling  [4] .  The  signal  flow 
graph  corresponding  to  equation  (12)  is  shown  dr  =  1/2 (d^  ♦  d^),  d^  *  d^  -  d^ 

in  Fig.  4. 

Computation  of  -lie  Fast  Hadamard  Transform  di  ’  *^dl  +  dS^  ’  W  dS 


The  fast  Hadamard  transform  may  also  be 
derived  from  the  binary  notation  of  j ,  where  i 
is  the  index  of  the  Hadamard  coefficient.  With 
N=8,  Fig.  2  and  Fig.  4  can  be  referenced  again. 
As  will  be  shown,  the  locations  (j  ,!>•)  under 
columns  b4,  b2,  bj  in  Fig.  2,  are  related  to 
the  corresponding  nodes  on  the  signal  flow 
graph  of  Fig.  4. 

From  the  graph,  it  may  be  apparent  that  the 
terms  (any  term  appearing  in  the  flow  graph  will 
be  given  the  general  symbol  d)  concurring  at 
any  node  differ  in  their  indexing  by  i.  The 
same  result  can  be  obtained  by  noting  where 
asymmetry  occurs  under  column  b^,  as  indicated 
by  the  horizontal  lines  in  Fig.  2.  The  math¬ 
ematical  operator  associated  with  these  two 
terms  is  determined  by  (-i)i»ki  or  [l-2x(j  ,b.)) . 
If  (j,b.)  =  0,  the  two  terms  d^  and  dj+j  arc1 
summed.1  On  the  other  hand,  if*  (j,b.)  =  1,  a 
subtraction  should  take  place.  From  Fig.  4, 
the  correct  formulation  is  d^  4  -  d.. 

j.i  3 

Any  two  terms  that  arc  summed  arc  also 
involved  in  a  subsequent  subtraction,  and  the 
results  can  be  stored  in  the  same  memory 
locations,  such  that 

'Jj  *  dj  *  dk 

dk=d.-dk  (14) 

where  d.,  dk  =  sampled  data,  intermiate  results 
J  or  Hadamard  coefficients , 

k  =  j  *  21 

i  =  0,1,2,...,  m-1 , 


d2  =  1/2 (d2  ♦  d6),  d6  =  d2  -  dfi 

d3  -  l/2(d3  ♦  d7),  d?  =  d3  -  d? 

Tlic  next  two  stages  of  computation,  for  i*2,l, 
may  be  similarly  developed.  The  general  steps 
to  implement  the  fast  Hadamard  transform  based 
on  binary  notation  correspond  to  the  signal 
flow  graph  of  Fig.  4,  except  for  the  necessary 
modification  mentioned  earlier. 


SUBROUTINE  FFHT2  (HR,N,H) 

DIMENSION  MR(N) 

C  HADAMARD  TRANSFORM  OF  A  REAL  SIGNAL 
C  MR  =  SAMPLED  DATA 

C  N  =  NO.  OF  DATA 

C  2**M  =  NO.  OF  COEFF.  PER  TIME  INTERVAL 
L  =  N 
K  =  1 

DO  3  NM  =  1,M 
1  =  0 

SoVS.l,*  D03NI-=1’L 

I  «  I  ♦  1 
J  =  I  +  K 

4  MR(I)  =  (MR(I)*HR(J))/2 

1  MP.(J)  =  MR(I)-MR(J) 

2  I  =  J 

3  K  =  K*2 
RETURN 
END 

For  the  inverse  liadamard  transform,  the  lines 
with  the  same  statement  numbers  are  to  be 
replaced: 

4  MR (I)  •  MR(I)  ♦  MR(J) 

1  MR(J)  =  MR(I)  -  MR (J)  -  MR(J) 


j  =  0,1,2 . N-l , 

excluding  those  of  k. 

For  a  general -purpose  computer,  computations 
are  done  in  a  serial  fashion.  Consequently, 
"in  place"  arithmetic  requiresthc  modification 
of  equation  (14)  to 

dk  c  dj  ’  dk  "  dk  (15) 

Computation  of  the  inverse  Hadamard  transform 
can  be  formulated  from  equations  (13)  and  (IS) 

In  computing  the  Hadamard  transform,  the 
normalization  factor  of  1/N  (N=2m)  may  be  in¬ 
corporated  into  each  of  the  m  stages  of  compu¬ 
tation  as  a  factor  of  1/2,  thereby  preventing 
the  possibility  of  an  "overflow"  in  integer 
arithmetic.  Accordingly,  the  basic  equations 
for  the  Hadamard  transform  are 

d.  =  l/2(dj  +  dk)  (16) 

dk  *  dj  *  dk 


Conclusions 

The  entire  sequence  of  l’s  and  -l's  of 
a  Hadamard  function  can  be  deduced  from  its 
binary  indexing.  A  fast  Hadamard  transform 
algorithm,  using  "in  place"  computations,  is 
similarly  developed.  The  same  algorithm  can 
be  modified  to  compute  the  inverse  transform. 
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Abstract 

The  design  of  a  relatively  simple,  but  very 
fast,  digital  circuit  that  can  generate  both 
the  Hadamard  or  Walsh  coefficients  is  explained 
A  slight  modification  to  the  circuit  allows  the 
inverse  transform  to  be  performed  as  well.  A 
useful  communication  application  is  described. 

Introduction 


A  previous  paper  (1]  has  described  an  al¬ 
gorithm  for  implementing  the  fast  Hadamard 
transform  of  an  N-lcngth  data  array,  where 
N  «  2®,  using  "in  place"  computation.  A 
hardware  implementation  of  the  algorithm 
illustrated  by  Fig. 4  of  11 j  requires  m  adders 
for  each  coefficient  when  working  in  a  par¬ 
allel  node  of  operation.  If  m  »  1,  the  hard¬ 
ware  cost  per  coefficient  is  minimized.  This 
can  be  achieved  by  recycling  the  output  from 
the  adders  into  the  same  storage  registers  a 
times.  The  loss  in  speed  with  such  an  arrange¬ 
ment  is  immaterial  for  most  practical  appli¬ 
cations. 

Factorization  of  the  Hadamard  Matrix 


It  is  well  known  that  an  efficient  way  to 
inclement  the  Itidamard  transform  of  an  N- 
length  (N»2b)  real  signal  is  to  decompose  the 
transform  matrix  into  m  factors  that  have  many 
zero  elements,  thereby  reducing  the  number  of 
arithmetic  operations.  For  examnlc, 
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Each  factor  G^,  where  i  «  0,  1,  2,  is  an 
orthogonal  matrix.  Multiplication  of  Gj  and 
a  column  matrix  requires  only  additions  and 
subtractions  and  the  arithmetic  may  be  done 
"in  place".  A  fast  Hadamard  transform  algor¬ 
ithm  has  been  implemented  p  ]  based  on  the 
concept  of  equation  (2) . 


Matrix  Q  is  the  transpose  of  P,  or  vice 
versa.  Consequently  the  characteristics  of 
both  are  analogous.  It  may  be  sufficient  to 
describe  the  properties  of  P,  and  deduce  those 
of  Q  on  similar  guidelines. 


Computation  of  the  Fast  Hadamard  Transform 


It  may  be  observed  from  equation  (8)  that 
tho  product  of  matrix  P  and  a  one-dimensional 
array  involves  merely  additions  and  subtractions 
of  data  that  are  adjacent,  and  the  storing  of 
the  results  in  memory  registers  that  are  N/2 
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locations  ap.'.rt.  In  the  typical  computer, 
mathematical  calculations  are  done  in  a  serial 
fashion.  Hence,  in  software  simulation,  at 
least  one  other  array  is  required  as  a  buffer, 
as  illustrated  by  the  array  LR  in  the  Fortran 
subroutine  PHTR2  shown  below.  Each  factor  P 
corresponds  to  one  stage  of  computation.  After 
m  stages,  the  Hadamaid  coefficients  arc  located 
in  the  original  data  array. 

SUBROUTINE  PHTR2  (JR,LR,N,M) 

DIMENSION  JR(N) ,NR(N) 

C  HADAMARD  TRANSFORM  OF  A  REAL  SIGNAL 
C  JR  «  DATA  ARRAY 

C  LR  «  BUFFER  ARRAY 

C  N  =  2**H  ;  NO.  OF  DATA 
NH  -  N/2 
LF  -  1 

Ml  «  AND(M,  1) 

IF  (Ml.NE.O)  GO  TO  20 
MM  «  M 
K  «  NH 
GO  TO  22 

20  MM  =  M-l 
K  «  NH/2 

22  LL  •  K 

30  JF  =  LF+1 
IN  *  1 

DO  4  I  «  1 ,MM 
J  =  JF 

IF  (IN.LT.O)  GO  TO  2 
DO  1  L  =  LF,LL 

5  LR(L)  =  (JR(J-l)+JR(J))/2 

6  LR(L+K)«  LR(L)-JR(J) 

1  J  =  J+2 
GO  TO  4 

2  DO  3  L  *  LF.LL 

7  JR(L)  -  (LR(J-l)+LR(J))/2 

8  JR(L+K)«  JR(L)-LR(J) 

3  J  «  .T*2 

4  IN  »  -IN 

IF  (Ml.EQ.O)  RETURN 
IF  (Ml.LT.O)  GO  TO  40 
Ml  *  -1 
LF  «  LF+NH 
LL  ■  LL+N11 
GO  TO  30 

40  DO  9  I  «  1, Nil 
J  -  I+NH 

10  JR(I)  -  (JR(I)+JR(J))/2 

9  JR(J)  «  JR(I)-JR(J) 

RETURN 

END 

To  perform  the  inverse  Hadamard  transform,  the 
lines  with  the  same  statement  numbers  arc  to 
be  replaced  by  the  following: 

5  LR(L)  ■  JR(J-1)+JR(J) 

6  LR(L+K)  «  JR(J-1)-JR(J) 

7  JR(L)  «  LR(J-1)+1R(J) 

8  JR(L+K)  ■  LR(J-1)-LR(J) 

10  JR(I)  «  JR(I)+JR(J) 

9  JR(J)  «  JR(I)-JR(J)-JR{J) 

Hardware  Implementation  of  the 
Fast  Hadamard  and  Walsh  Transforms 

In  a  parallel-operating  system,  the  same 
memory  elements  may  be  utilized  to  hold  the 
original  sampled  data,  intermediate  results, 
and  eventually,  after  m  operations,  the  required 


Hadamard  coefficients  in  their  correct  order. 

A  preliminary  design  shows  that  it  is  possible 
to  use  complement  arithmetic  along  with  M.S.I. 
adder  packages  available,  and  D-type  flip-flops 
arranged  as  registers  for  the  sampled  data  as 
well  as  the  coefficient  values. 

A  general  rule  for  recycling  of  the  results 
.  from  the  output  of  the  adders,  based  on  equation 


(8),  is  thus  given  by: 

dj  ’  Wdk  +  *W 

(10) 

■W  *  '  dUl> 

(ID 

where  j  *  0,1,2, . .  (N/2-1), 


for  k  =  0,2,4, . .  N-2. 

Fig.  1  demonstrates  a  proposed  digital 
circuit  that  will  implement  the  fast  Hadamard 
transform  for  the  determination  of  8  coefficients. 
The  expansion  to  a  circuit  that  will  obtain  the 
first  64  coefficients  is  straightforward  and 
will  have  the  same  general  structure  as  the 
circuit  of  Fig.  1.  Under  the  assumption  that 
a  7-bit  coefficient  value  is  sufficient,  with 
the  eighth  bit  handling  transient  arithmetic 
overflow,  the  cost  per  coefficient,  with  off- 
the-shelf  components,  would  be  approximately 
$12.00. 

For  N  »  26,  (i.e,  64  coefficients)  the 

circuit  need  only  be  clocked  6  times,  with 
adequate  tine  between  clock  pulses  to  allow 
the  output  of  the  adders  to  settle.  With 
modern  IC’s  this  should  be  accomplished  in 
less  than  200  nanoseconds.  A  circuit  for 
obtaining  128  coefficients  would  take  about 
250  nanoseconds. 

The  Hadamard  coefficients  may  be  rearranged 
to  obtain  the  Walsh  ordering.  In  a  hardware 
implementation  to  obtain  the  Walsh  coefficients, 
a  straightforward  approach  would  be  to  add  a 
new  set  of  registers  at'  the  output  of  the  adders 
to  hold  the  Walsh  coefficients.  This  is  illu¬ 
strated  in  Fig.  1. 

Note  that  the  forward  and  the  inverse  trans¬ 
forms  differ  only  by  a  simple  factor  of  2[1]  . 
Accordingly,  a  shifting  of  the  bit  lines  return¬ 
ing  to  the  storage  registers  by  one  bit  will 
allow  the  inverse  transform  to  be  performed  by 
the  same  hardware. 


ilication  of  the  Parallel  Hardware  Array 


A  possible  communication  system  using  this 
novel  hardware  design  is  shown  in  F.ig.  2.  This 
is  a  combination  transmitter-receiver  assumed 
to  be  used  in  a  mobile  communication  system 
(e.g.  an  aircraft)  in  such  a  way  that  the  bit- 
rste  of  transmission  is  lower  than  standard 
PCM  systems.  Others  [3,4,5  }  have  demonstrated 
the  feasibility  of  this  approach.  The  circuit 
proposed  here  is  a  tentative  design  for  a 
speech  communications  system.  It  determines 
and  transmits  the  eight  dominant  coefficients 
out  of  a  field  of  64  in  either  the  Hadamard  or 
Walsh  domains.  Similarly,  it  can  receive 
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"dominant1'  coefficients  and  reconstruct  the 
necessary  waveform.  Conseouently,  for  such  a 
cousunication  system  the  relevant  data  are 
formatted  as  the  amplitude  of  the  coefficient 
and  the  corresponding  coefficient  number. 

These  data  words  are  transmitted  over  standard 
data  links  to  similar  tr?  ismittcr-receivers. 

It  is  estimated  that  a  total  package  of  this 
type  would  cost  about  $3,000  -  $5,000.  Future 
research  will  be  aimed  at  constructing  such  a 
package  and  comparing  its  operation  with  other 
forms  of  digital  transmission  of  speech. 

Conclusion 

It  is  shown  that  the  decomposition  of  a 
lladamard  matrix  into  identical  factors  leads 
to  the  implementation  of  a  feasible  software 
subroutine  and  a  high-speed  hardware  design 
for  the  fast  lladamard  transform.  The  same 
hardware  can  be  modified  for  the  fast  Walsh 
transform,  and  for  the  inverse  transform  as 
well.  A  tentative  design  of  a  digital  trans¬ 
mitter-receiver  system  is  proposed. 
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Abstract 


An  efficient  algorithm  is  used  to  obtain 
64  Hadaaard  coefficients  for  every  8  milli¬ 
seconds  of  speech.  Using  only  8  or  4  of  these 
coefficients,  it  is  possible  to  reconstruct 
intelligible  speech  on  a  CDC-1700  computer 
system.  The  results  of  this  investigation 
into  speech  analysis  and  synthesis  in  the 
Hadamard  domain  arc  presented. 

Introduction 

Several  previous  papers  [1,2,3]  have  de¬ 
monstrated  the  feasibility  of  using  the 
discrete  Hadamard  or  Walsh  transform  in  image 
or  speech  processing  with  promising  results. 
The  immediate  objective  of  this  research  is 
to  evaluate  the  usefulness  of  transforming 
speech  to  the  Hadamard  domain,  retaining 
several  dominant  coefficients  per  specific 
time  interval,  and  then  reconstructing  the 
original  signal  from  these  coefficients.  The 
long-range  goal  is  to  reduce  the  bit-rate 
necessary  for  speech  communication  over  data 
links  for  those  applications  r-.quiring  intel¬ 
ligibility  rather  than  high  quality,  and 
simultaneously  to  reduce  the.  memory  require¬ 
ment  of  any  associated  hardware. 


Liter  Facility  and  Implementation 


A  block  diagram  of  tho  CDC-1700  computer 
system  and  the  apparatus  used  to  perform  this 
experiment  is  illustrated  in  Fig.  1.  The 
present  configuration  of  the  system  is  such 
that  the  I/O  bus  can  only  handle  A/D  or  D/A 
conversion  one  at  a  time,  in  a  buffered  mode. 
Consequently,  real-time  operation  is  not 
possible,  although  the  algorithms  used  are 
sufficiently  fast  that  real-time  operation 
(actually  a  16  msec,  delay)  can  be  contem¬ 
plated  in  the  future. 

The  original  sentences  for  analysis  and 
synthesis  were  taken  from  a  master  tape 
supplied  by  the  1972  International  Conference 
on  Speech  Communication  and  Processing.  The 
speed)  waveform  was  sampled  at  an  8KHz.  rate, 
and  the  data  were  formatted  into  14- bit  words 
by  the  A/D  converter.  These  digital  samples 
were  stored  on  a  disk  capable  of  holding  1 .5 
million  words.  Only  12  cylinders  out  of  a 
total  of  99  wore  used,  which  correspond  to 
approximately  23  seconds  of  speech  being 
handled  on  one  pass.  A  fast  Hadamard  transform 
algorithn  [4]  was  used  to  transform  every 
group  of  64  data  words  into  the  first  64 
coefficients  in  the  Hadamard  domain.  For 
the  sampling  rate  used,  the  update  time  inter¬ 
val  was  thus  8  milliseconds.  The  dominant 
(in  terms  of  largest  absolute  value)  8  (or  4) 


coefficients  were  selected  through  another 
software  algorithm.  Synthesis  was  performed  by 
using  the  dominant  coefficients,  their  corre¬ 
sponding  coefficient  numbers,  and  the  inverse 
Hadamard  transform.  The  results  were  stored  on 
the  disk,  destroying  the  original  data  file. 

A  final  D/A  conversion  through  a  low-pass  filter 
produced  the  resultant  analog  signal  that  was 
recorded  on  tape. 

Format  and  Bit -rate  of  Test  Results 

The  tape  recording  presents  the  results  as 
first,  the  "original "speech.  This  is  simply 
the  original  digital  samples  sent  directly 
through  the  D/A  converter  to  demonstrate  the 
degradation  of  the  speech  waveform  due  to  the 
operating  system.  The  bit-rate  of  data  transfer 
is  equivalent  to  112,000  bits/seconds.  Scaling 
the  14  bit  words  to  6  or  7  bits  (about  48,000 
bits/second  )  shows  little  change. 

The  second  recording  was  speech  reconstructed 
from  the  dominant  eight  coefficients  of  an 
analysed  64  coefficients,  updated  ever  8  milli¬ 
seconds.  To  specify  the  coefficient  number,  6 
bits  are  required.  The  coefficient  amplitude 
values  are  of  7  bits  (including  sign) .  In 
effect,  this  corresponds  to  an  average  bit-rate 
of  reconstruction  of  13,000  bits/second. 

The  final  recording  was  made  using  the  four 
most  dominant  coefficients  in  the  same  8  milli¬ 
second  time  interval.  The  reconstructed  signal 
corresponds  to  a  bit-rate  of  6,500  bits/second. 

The  tentative  results  presented  here  are 
the  beginning  of  a  project  to  determine  an 
effective  digital  scheme  for  minimizing  the 
bit-rate  of  data  transfer  for  intelligible 
speech  communication.  For  this  purpose,  the 
algorithms  used  in  the  research  are  made  suf¬ 
ficiently  flexible  such  that  changes  may  be 
made  on  the  sampling  rate,  the  update  time  in¬ 
terval,  and  the  number  of  dominant  coefficients 
for  synthesizing  speech.  A  possible  outcome 
of  this  approach  is  the  production  of  an 
inexpensive  audio  voice  response  unit  for  a 
computer  that  will  require  a  minimum  of  memory 
storage.  To  this  end,  future  research  is  aimed 
at  analysing  phonemes  and  diphones,  with  an 
attempt  to  create  a  digital  vocabulary  for 
voice  synthesis. 
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Introduction 

An  analog  LCS  serial  resonant  filter  for 
Walsh  functions  is  presented.  Difference  equa¬ 
tions  describing  the  lossless  resonant  filter 
were  programmed  on  a  general  purpose  com¬ 
puter  to  simulate  the  filter  as  a  digital  reso¬ 
nance  filter  [1-3].  The  direct  programming 
form  for  digital  simulation  was  modified  by 
using  time  variable  coefficients  to  simulate  the 
time  var  iable  switch  necessary  for  tuning  the 
filter  to  a  discrete  sequency.  The  steady  state 
difference  equations  necessary  for  digital 
simulation  of  a  lossy  analog  LCS  resonant 
filter  are  also  given. 

Fundamentals 

The  serial  resonance-  filter  for  Walsh  func¬ 
tions  as  shown  in  Fig.  1  is  basically  the  same 
as  for  sinusoidal  functions  except  that  it  has  a 
switch  S  which  is  used  to  tune  the  resonant 
filter.  TO  illustrate  the  properties  of  this  cir¬ 
cuit,  let  switch  S  be  closed,  switch  Sq  be 
open,  vi(0)  =  V} ,  v^O)  =  V2  and  C^  =  C2  =  C. 
The  current  and  voltages  yield  the  following 
equations: 

i(t)  (yi-V2)  sin  ut  (1) 


vi(t)  =  Vj  -  |  (VX  -  V2)  (1  -  cos  u>t) 

v2(t)  =  V2  +  (Vj  -  V2)  (1  -  cos  ut) 

where  w  =  n/2/LC.  At  time  t  =  ir/u>,  the  cur¬ 
rent  goes  to  zero  and  the  voltages  are 

v^jt/w)  =  V2  (2) 

v2(n/w  )  =  V 1  . 

The  Important  point  is  that  the  capacitor 
voltages  at  t  ^  0  and  t  =  vfa  have  interchanged 
values.  To  make  use  of  this  property,  assume 
that  the  sampled  Walsh  function  sal(4,0)  as 
shown  in  line  i  of  Fig.  2  is  applied  to  capacitor 
Ci  by  instantaneously  closing  and  opening 


Fig.  1.  Serial  LCS 
Resonance  Filter. 


-T/2  0  t—  T/2 


Fig.  2.  Time  Diagram  for  a 
LCS  Resonance  Filter  Tuned 
to  the  Forcing  Function. 

switch  Sg .  The  sampled  function  sal(4,0) 
must  be  in  the  form  of  a  charge  source  if  volt¬ 
age  is  to  be  added  accumulatively  to  Ci .  Let 
vi(t+T/2)  =  v^,t+T/2)  s  0  and  suppose 
q  =  +V1C  is  applied  to  Ci  at  time  t  =  -7T/16 
as  shewn  in  line  2  of  Fig.  2  which  gives 

Vj(t-7T/16)  =  Vi  (3) 

v2(t  -  7T/16)  0. 

According  to  the  results  of  equations  (1)  and  (2), 
the  voltages  will  interchange  in  the  next  time 
interval  of  At  -  T/8  which  gives 

vj  (t  -  5T/16)  «  0  (4) 

v2(t-5T/16).  a  Vj 

as  shown  in  line  4  of  Fig.  2.  The  charge 
q  *  -VjC  is  then  applied  to  Ci  at  time  t  - 
-5T/16  according  to  the  sampled  Walsh  function 
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sal(4,0).  Again  the  voltages  interchange  and  this 
building  up  process  continues  until  steady  state 
is  reached.  It  should  be  noted  that  switch  S  is 
closed  throughout  this  discussion,  thus,  tuning 
the  filter  to  the  forcing  function  sal(4,0).  It  iB 
noted  that  the  voltage  v2(t)  is  the  complement 
of  the  forcing  function  sal(4,0)  which  implies 
the  desired  condition  for  resonance. 

Consider  sal(3,0)  as  shown  in  line  5  of 
Fig.  2  with  all  initial  conditions  set  to  zero. 

The  charge  q  =>  -V^C  is  applied  to  at 
time  t  =  -7T/16  and  the  voltages  are  then  al¬ 
lowed  to  interchange.  The  charge  q  *  +VjC  is 
applied  at  t  =  -5T/16,  however,  the  voltages 
are  not  allowed  to  interchange  this  time. 

Switch  S  Is  opened  at  t  =  -5T/16  and  it  re¬ 
mains  open  for  the  duration  t  =  T/8  as  shown 
in  line  8  of  Fig.  2.  The  switch  S  could  be 
opened  at  that  time  since  the  current  Is  zero. 

At  time  t  =  -3T/16  switch  S  is  closed  and  the 
charge  q  =  +V^C  is  applied  to  Cj  .  The  volt¬ 
ages  are  allowed  to  interchange  as  before.  If 
this  process  is  continued  with  the  switch  S 
being  opened  (whitecrrzi)  and  closed  (black  an) 
as  shown  in  line  7  of  Fig.  2,  the  voltages  will 
build  up  with  time  which  implies  that  the  circuit 
is  a  serial  resonant  LCS  filter  for  time  sam¬ 
pled  Walsh  functions.  The  switching  character¬ 
istics  of  switch  S  is  the  determining  factor 
necessary  for  resonance  to  occur. 

Fig.  3  shows  what  will  happen  if  the  forcing 
function  sal(3,0)  is  applied  to  the  circuit  that 
is  tuned  to  sal(4,0)  and  vice  versa.  The  volt¬ 
ages  do  not  build  up  with  time  which  implies 
that  the  circuit  is  not  tuned  for  resonance. 
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Fig.  4.  Time  Diagrams  Illustrating 
Separation  properties  for  LCS  Res¬ 
onance  Filter  for  Sum  of  Two  Walsh 
Functions. 

shown  in  line  6  of  Fig.  4.  Note  that  v2  clearly 
indicates  the  resonance  condition. 

Since  the  voltages  v^t)  and  v2(t)  are  only 
of  interest  at  certain  time  points  tjj  =  n-/4o>  + 
T/16  where  n  =  0,  ±1,  ±2,  ...  according  to 
Fig.  2,  difference  equations  may  be  used  for 
the  analysis  of  the  circuit  of  Fig.  1.  Denote 
vl(t„)  by  vjOri)  and  vo(t„)  by  v2(n)  with  switch 
S  always  closed  and  So  always  open.  Accord¬ 
ing  to  equation  (2)  the  voltages  v<  (n)  and  v2(n) 
are  related  by  the  following  two  difference 
equations  of  first  order: 

vjOi  +  l)  »  v2(n),  v2(n  +  l)  =  vj(n).  (5) 

If  the  switch  Sq  Is  momentarily  closed  at  the 
time  t,,,  the  applied  charge  qn  »  Cvj’(n)  in¬ 
creases  the  voltage  across  Cj  from  vj(n)  to 
vj(n)  +  vi’(n).  Equations  (5)  will  assume  the 
following  form 

vj(n  +  l)  «  v2(n),  v*j(n  + 1 )  -  vj(n)  +  Vj’fn).  (6) 

Separation  of  the  variables  yields  two  differ¬ 
ence  equations  of  second  order: 

Vj(n  +  2)  -  vj(n)  »  vj’fn),  (7) 


Fig.  3.  Time  Diagram  for  a 
LCS  Resonance  Filter 
Tuned  to  the  Forcing  Function. 


The  separation  of  the  sum  of  two  Walsh 
functions  Is  illustrated  in  Fig.  4.  If  the  Input 
signal  Is  aal(l,0)  +  sal(3,0)  as  shown  on  line  3 
with  the  filter  tuned  to  sal{3,0)  as  indicated  by 
line  5,  the  output  voltages  vj  and  v2  are 


v2(n  +  2)  -  vj(n)  -  vj^n  +  l). 

It  would  be  Instructive  to  carry  the  differ¬ 
ence  equation  technique  one  step  further  by  con¬ 
sidering  sal(3,0)  as  applied  to  Figs.  1  and  2 
[4].  In  analogy  to  (6)  the  following  sets  of  equa¬ 
tions  are  derived  from  Fig.  1  and  line  8  of 
Fig.  2:  * 
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Vl(n+1)  «  v2(n)  (8)  (Cont.) 


vjOt+2)  =  vj(n+l)  +  vj‘(«i+l)  (8) 

(Con t.) 

vjln+3)  =  ,’2(n+2) 

Vj(n+4)  s  V2(n+3) 

2(n+l)  3  v^n)  +  vj'(n) 

v2(n>2)  =  v2(n+l) 

v2(n+3)  =  v^(n+2)  +  Vi'(nv2) 

v2(a+4)  =  v^(n+3)  +  vi'(n+3) 

where  n  =  0,4, 6,12, ...  ,  H,  ...  .  Separation 
of  the  variables  yields: 

v^n+l)  •*  vi’(n-l)  +  vjte-l)  (B) 

vj(a+2)  =  vj*(n+l)  +  vj(n  +  l) 

Vj(n+3)  3  v^*(n)  +  vj(a; 

Vj(n+4)  =  vj'(n+2)  +  v-(n+2) 

v2(n+l)  =  v1'(n)  +  v^n-l) 

v2(n+2)  =  v2(n+l) 

v2(n+3)  =  v1'(n+l)  +  v1'(n+2)  +  v2(n) 
^^+4)  *  vj’(n+3;  +  v2(n+2) 
where  n»4i,  i  »  0, 1, 3, . . .  . 


The  ideal  digital  I  CS  resonant  filter  car 
be  simulated  on  a  general  purpose  digit*! 
computer  by  programming  the  differsoca  eqca- 
ticns  which  des wiOe  the  particular  resonance 
filter. 

The  simulation  of  the  digital  resonant 
filter  tuned  to  3p.1(4,0)  can  be  accomplished  by 
rearranging  equations  (7)  by  shifting  back  two 
time  units  which  gives 

vi(o)  *  vj  ’(n  «  2)  +  vj(n  -  2)  (10) 

vgW  -  vj’(n-l)  +  v^n  - 3). 

Let  the  following  changes  in  notation  be 
made  to  aid  in  programming  the  variables 
n  -  J,  vt  —  VI,  v2  -  V2  and  VlV. 
Equation  (10)  now  becomes 

V1(J)  3  VI V(J  -  2)  +  VX(J  -  2)  (11) 

V2(J)  *  VI V(J ^  *.)  +  #3(J  -  2). 

Equation  (11)  can  be  simulated  in  btok  d-a* 
gram  form  u?*<ng  the  direct  form  of  programming 


as  shown  in  Fig.  5  where  0  indicates  a  time 
delay  of  one  unit  time.  Figure  6  shows  the  re¬ 
sults  when  the  input  forcing  function  VlV  = 
sa](4,0)  with  the  filter  tuned  to  sal(4,6).  Note 
that  the  filter  resonant  condition  has  been  met 
as  previously  defined.  If  another  Walsh  func¬ 
tion  were  applied  as  the  input,  resonance  would 
not  occur  as  simulated  by  Fig.  7  whore  VlV  « 
scl{3,0).  The  voltages  VI  and  Y2  were  limited 
to  a  ±  value.  This  limithrg  process  '.s  neces¬ 
sary  since  the  digital  simulation  is  turntable  and 
the  output  voltages  would  continue  tc  increase 
as  long  as  the  input  is  applied.  This  would,  of 
course,  be  expected  for  a  resonance  circuit 
when  applying  an  input  at  the  same  sequency  as 
the  filter  is  tuned.  This  is  directly  «<Alogous 
to  the  resonance  filters  in  the  frequency  domain. 


Fig.  5.  Simulated  Block  Diagram 
of  Digital  Filter  Resonance  Tuned 
to  sr  1(4,0). 


Fig.  8.  Filter  Tuned  to  sal 
(4,0)  with  VlV  »  sal(4,0). 

The  simulation  of  the  digital  filter  shown 
in  Fig.  5  which  used  the  direct  programming 
form  bad  constant  coefficients  of  either  plus 
;ofe  or  zero  in  the  feedback  and  feed  forward 
loops.  The  constant  time  invariant  coefficients 
provided  a  rather  simple  simulation.  Suppose 


~V1(J)  =  Vl(J-2)  +  Vl(J-2)  1 
°I+7,J  i 

_V2(J)  -  V1V(J-1)  +  V2(J-2)J 


(15) 


Fig.  7.  Filter  Tuned  to  sal 
(4,e)  Pith  ViV  =  sal{3,9). 


ttse  same  type  (direct)  of  programming  form  be 
used  to  simulate  a  digital  filter  tuned  to 
601(3,9).  This  would  inquire  the  coefficients 
is  be  time  varirblo  with  valuer  of  plus  one  cr 
zero  depending  cn  the  time  necessary  to  cause 
resonance.  The  simulated  Week  dingram  of  the 
digital  filter  tuned  to  sal(3,9;  is  shewn  in 
Fig.  8  where  the  Krcuecker  Delta  is 

«I44,J  =  ?  u  1  +  4  =  J 
*  0  if  1  +  4  *  J. 

Figure  8  is  the  siTuiilatioft  of  equation  (8)  where 
the  following  notations  have  oeen  changed  to 
facilitate  programming  the  aqurlions  4i  +  1  -» 

I  +  4,  4i  -I,  m  -  J,  v{  -  VIV,  v1  -  vi, 
v2  —  V2.  Equation  (C5  can  be  rewritten  using 
the  Kronecker  Delta  notation  as  follows: 

~V£(J)  *  VlV(J-S) + Vl(d-2)' 

*1*4,3  (12) 

l.V2'T) «  VI  V(  J-l ) + V2(J-4). 


Fig.  8.  Simulated  Block  Diagram 
ri  Digital  Resonance  Filter  Tuned 
to  881(3,  6). 

Figure  9  shows  the  digital  simulation  of 
the  resonance  filter  tuned  to  saifS, 9)  with 
sal(3,9)  applied  as  the  forcing  function.  The 
steady  state  condition  is  simulated  the  same 
as  diacuBsed  earlier.  The  non-resonance 
condition  is  seen  in  Fig.  10  where  the  forcing 
function  is  sal(4,0). 


Jim 


71(J)  *  VI  V(J-1 ) + V3(J-1  )' 

oi+5  .J  <13' 

V2(J)=V3(J-1) 

fVl(J)*  VlV(J-3;  +  Vl(J-3) 

i_V2(J)*yiV(J-2>+  nv»‘J  *1. +t/2(J-3)_ 

(14) 


Fig.  9.  Filter  Tuned 
to  sal(3,e)  with  VIV  * 

881(3,9). 

The  separation  property  of  the  digital 
filter  can  be  seen  in  Fig.  11  where  VIV  ° 
sal(l,9)  +  sal(3,9).  The  output  voltage  V2  is 
clearly  sel(3,e)  which  has  been  separated  from 
its  sum  with  sal(l,9).  This  result  is  analogous 
to  the  sum  of  frequencies  being  separated  by  a 
resonance  filter  in  the  frequency  domain. 

The  difference  is  that  frequency  resonance 
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Fig.  10.  Filter  Tuned 
to  sal(3,0)  with  VI V  = 
sal(4,0). 


simulating  this  type  of  digital  filter  should 
make  their  future  very  promising. 

Derivation  of  Steady  State 
Difference  Equations 

The  digitiJ  simulation  of  the  theoretical 
model  of  the  LCS  serial  resonance  filter  has 
been  presented.  The  difference  equations 
which  were  simulated  assumed  perfect  ele¬ 
ments  with  no  losses.  The  simulation  of  an 
actual  analog  model  would  require  that  lossy 
elements  be  considered  in  the  derivation  of  the 
difference  equations.  To  do  this,  assume  that 
switch  S  of  Fig.  1  when  closed  has  a  resistance 
R  and  that  the  initial  voltages  across  the  ca¬ 
pacitors  are  vWO)  =  Vi  and  v2(0)  =  V2  •  Solve 
for  i(t),  vj(t)  and  v2(t)  for  Cj  =  C2  =  C  with 
Sq  open  if  S  is  closed  at  t  =  0.  The  integro- 
differential  equation  fox*  the  circuit  in  Fig.  1  is 


Vi-v2  =  L^+|'J  i(t)  dt  +  Ri(t). 


TV 


The  current  and  voltages  yield  the  following 
equations: 


=  j/J  (VX  - V2)  e-at  sin  cot  (1?) 


a  /  A  A _ / 


i  oo  *i.oc  i  fo  n  w»  or 
7  :wf 


Fig.  11.  Filter  Tuned 
to  sai(3,0)  with  V1V  = 
sai{l,0)  +  eal{3,0). 

filters  pass  a  band  of  frequencies;  whereas,  the 
seqveucy  resonance  filter  passes  only  a  dis¬ 
crete  sequtmey. 

Digital  resonance  filters  tuned  to  other 
Walsh  functions  can  be  developed  using  these 
techniques.  The  simplest  version  sal(4,0)  and 
the  most  difficult  aal(3,0)  were  illustrated 
here.  The  difficulty  of  the  others  lies  between 
these  two  extremes.  The  relative  ease  of 


n(t)  =  vj  -|(V1-V2) 

x  1  -  £~at  (—  sin  cot  +  cos  cot) 
\co  / 

v2(t)  =  V2  +  -|(V1-V2) 

xL  e"®*  (—  sin  u>t  +  coa  cut) 
\co  ! 


where  C}  =  C2  =  C,  cog  =  2/LC,  a  =  R/2L  and 

2  2  2 
0)  =  Wq  -  or  . 

The  following  relations  are  obtained  at  the 
time  t  =  (it A'): 

i(j t/co)  *  0  (20) 

v1(jt/o»)  =  (Vt+V2)  -  K 

v2(!I/w)  =  (Vj  +  V2)  +  K 
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where 


V1(J)  =  V1(J  - 1 )  +  0.5  VI V(J  - 1 ) 


K  =  {(V1-V2)£Ww. 

K  must  be  a  positive  real  number  for  any 
physical  realizable  circuit  if  V^  >  V2 .  The 
voltages  across  the  capacitors  at  t  =  0  and 
t  =  n/(j)  no  longer  interchange  as  for  the  ideal 
circuit.  If  R  =  500  0,  f  =  400  Hz,  L  =  0.21  Hy 
and  C  =  1.5  juF  [2],  the  constant  K  becomes 


K  =  0.115^  -V2). 

Let  the  initial  voltages  be  Vj  =  1  and  V2  =  0. 
The  voltages  at  t  =  a/co  become 

VjOr/w)  =  0.5  -  0.115  =  0.385 

v2(ir/“> )  =  0.5  +  0.115  =  0.615 . 


6I+4,J 


V2(J)  =  V2(J  -1)  +  0.5  V1V(J-1)J 
V1(J)  =  Vl(J-l)  +  VlV(J-lf) 


6I+5,J 


_V2(J)  =  V2(J  -1) 
Vl(J)  =  Vl(J-l) 


6I+6,J 


V2(J)  =  V2(J  -1)  +  V1V(J-1) 


(22) 


(23) 


(24) 


For  this  value  of  K,  the  voltages  would 
slowly  build  up  as  time  increases.  Since  K 
varies  exponentially  with  the  amount  of  resist¬ 
ance,  an  i  jrease  in  R  would  decrease  the 
constant  K  substantially.  For  example,  sup¬ 
pose  R  =  1000  fl;  then  K  would  equal  0.052  as 
compared  to  0.115  for  R  =  500  12.  This  implies 
that  as  the  series  resistance  of  the  circuit  ap¬ 
proaches  infinity  the  constant  K  approaches 
zero.  Under  this  condition,  the  voltages  will 
not  build  with  time  but  will  remain  at  a  steady 
state  value  as  long  as  an  input  signal  as  the 
proper  sequency  is  applied.  Upon  removal  of 
the  input  signal  the  output  will  damp  out  very 
quickly.  The  point  is  that  an  analog  LCS  serial 
resonance  filter  contains  a  considerable 
amount  of  series  resistance.  The  effect  of  the 
series  resistance  is  to  prevent  the  continual 
building  up  as  predicted  by  the  lossless  circuit. 
This  would  imply  that  K  is  small  enough  to  be 
considered  as  zero. 

The  difference  equations  for  this  condition 
can  be  derived  similar  to  equations  (11)  which 
are 


V1(J)  =  Vl(J-l)  +  0.5  V1V(J-1)  (21) 

V2(J)  =  V2(J  -1)  +  0.5  V1V(J  - 1). 

The  digital  simulation  under  the  steady  state 
condition  for  the  filter  tuned  to  sal(4,0)  can  be 
obtained  by  simply  substituting  equations  (21) 
for  the  equations  (11). 

The  difference  equations  for  Uie  steady 
state  condition  with  the  filter  tuned  to  sal(3,0) 
can  be  derived  similar  to  equations  (12)  -  (15) 
are 


■'l(J)  =  V1(J  - 1)  +  0.5  VI V(J  - 1) 


5I+7,J 


V2(J)  =  V2(J -1)  +  0.5  VlV(J-l) 


(25) 


For  steady  state  digital  simulation  the  equations 
(22)  -  (25)  would  reolace  the  equations  (12)  - 
(15). 

Conclusion 

The  LCS  resonant  filter  for  Walsh  functions 
was  successfully  simulated  on  a  general  pur¬ 
pose  computer.  The  digital  si, nutation  of  the 
resonance  filter  was  based  on  a  set  of  differ¬ 
ence  equations  which  described  the  lossless 
theoretical  model.  Therefore,  the  simulated 
output  had  to  be  limited  to  an  arbitrary  value 
to  mimic  the  steady  state  condition  of  an  analog 
filter.  The  steady  state  difference  equation  for 
the  lossy  analog  circuit  was  derived. 

The  resonance  condition  is  clearly  indi¬ 
cated  by  the  filter  if  and  only  if  the  forcing 
function  is  at  the  same  sequency  as  the  filter 
is  tuned. 

With  the  advent  of  integrated  circuits  ana¬ 
log  or  continuous  Walsh  functions  may  easily 
(  i  generated  and  used  for  carriers  in  multi¬ 
plexing  or  coding  systems.  Discrete  Walsh 
functions  can  easily  be  generated  by  special 
purpose  or  general  purpose  computers  which 
could  also  be  used  for  multiplexing  or  coding. 
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Abstract 

In  this  paper,  the  characteristics  of  a 
resonant  sequency  filter  proposed  by  Harmuth  [1] 
and  constructed  by  Golden  [2]  are  examined  in 
the  z-domaln  as  a  digital  filter.  Special- 
purpose  digital  hardware  is  proposed  to  realize 
resonant  sequency  filters  and  a  BASIC  simu¬ 
lation  is  used  to  verify  the  scheme. 

Introduction 

A  digital  filter  is  a  discrete-time  device 
which  transforms  an  input  data  stream  into  an 
output  data  stream  by  an  algebraic  process 
cescrlbed  by  constant  coefficient  difference 
equations.  The  transfer  function  D(z)  nay  be 
conveniently  defined  in  the  z-domain  (z“l  - 
e-Tsj  t  is  the  sampling  period,  and  s  the 
Laplace  variable) , 

a„  +  a. z"1  +  ...  +  a  z-n 
D(Z)  -  - - - — 

l  +  b,z  +...+bzn 
1  n 


where  a^  and  b^  are  real  coefficients. 

The  digital  filter  specificied  by  a  z- 
domain  transfer  function  may  be  physically 
realized  in  several  ways;  general-purpose 
computers,  special-purpose  computers  [3,4],  or 
hybrid  devices  [5].  The  digital  transfer 
function  D(z)  may  be  programmed  in  several 
difference  equation  forms  [6,7].  One  of  the 
most  common  forms  is  the  direct  form  shown 
below: 

e0(kT)  -  a0e^(kT)  +  a^kT-T)  +  ••• 

+  a^CkT-nT)  -  b^CkT-T)  - 
-  bne0(kT-nT) 

where  k  i3  an  integer,  e^(kT)  is  the  filter 
input,  and  eg(kT)  Is  tae  filter  output.  The 
sampling  period  T  is  usually  omitted  to  sim¬ 
plify  the  notation. 

Now  let  us  consider  the  poles  and  zeroes  of 
D(z) .  The  z-plane  is  defined  as  a  mapping  of 
the  s-plane  according  to  the  rule 


If  we  define  ws  «  2»fs  “  2ir/T,  then  the  s- 
plane  may  be  divided  into  "strips"  as  shown 
in  Figure  1.  One  can  show  that  the  primary 
strip  in  Figure  1  maps  into  the  unit  circle  of 
the  z-plane  of  Figure  2.  Futhermore,  one  can 
show  that  the  region  of  stability  in  the  8-plane 
is  the  left-half  plane;  in  the  z-plane,  inside 
the  unit  circle.  An  important  point  to  note  is 
that  the  origin  (s«0)  in  the  s-plane  maps  to 
unity  (z*l)  in  the  z-plane. 

LCS  Resonant  Filter 

The  LCS  resonant  filter  proposed  by 
Harmuth  [1]  and  implemented  by  Golden  [2]  used 
a  switching  scheme  to  transfer  charge  between 
two  capacitors.  If  the  voltages  on  the  capac¬ 
itors  are  label  x(t)  and  y(t),  the  difference 
equations  for  the  filter  tuned  to  Sal(3,B)  are 

x(n)  »  i(n-2)  +  x(n-2) 

x(rrt-l)  »  i(n)  +  x(n) 

x (n+2)  -  i(n-l)  +  x(n-l) 

x(n+3)  «•  i(n+l)  +  x(n+l) 

y(n)  -  i(n-l)  +  y(n-2) 

y(n+l)  »  y(n) 

y(n+2)  -  i(n)  +  i(n+l)  +  y(n-l) 
y(n-r3)  “  iCn+2)  +  y(n+l) 
n  -  1,  5,  9, • ’ * 

where  i(n)  is  the  input  signal.  The  initial 
conditions  are  specified  by  defining  values 
for: 

i(-l)  -  0 
i(0)  -  0 
x(— 1)  -  0 
x(0)  -  0 
y(-l)  -  0 
y(0)  -  0 


The  difference  equations  for  x(t)  may  be 
transformed  into  the  z-domain  to  yield  the 
following  transfer  functions: 


(z-l)(z+l) 


»<=>  ■ 


t  -  T,  5T,  9T, 


t  -  2T,  6T,  10T,  ••• 


(z-1) (z+.5+j .866) (z+.5-j .866) 
t  -  3T,  7T,  11T, 


(z-1) (z+1) 


4T,  8T,  12T, 


An  important  point  to  note  is  that  each  D(z)  has 
a  pole  at  z  *  1.  This  pole  corresponds  to 
integration  in  the  s-domaln.  Hence,  a  resonant 
sequency  filter's  input  signal  must  have  a  zero 
average  value. 

Special-Purpose  Hardware 

The  analog  J.CS  resonant  sequency  filter 
by  Harmuth  [1]  suggests  the  digital  imple¬ 
mentation  shown  in  Figure  3.  The  input  signal 
is  sampled  by  an  A/D  converter.  There  are 
three  accumulators  (AO,  Al,  cna  A2),  a  scratch¬ 
pad  memory,  data  routing  logic,  a  sign  register, 
a  tuning  register,  and  a  match  register. 

Operation 


The  operation  of  the  digital  resonant 
filter  follows  these  four  phases: 

(11  Setup 

(2)  Sampling 

(3)  Transient  Response 

(4)  Sign  Detection. 

Setup,  lhe  setup  phase  consists  ot 
clearing  AO,  Al,  and  A2;  loading  a  four-bit 
tuning  word  into  the  tuning  register;  and 
loading  an  eight-bit  word  into  the  matching 
register.  The  tuning  and  matching  words  are 
shown  in  Table  1.  Also,  the  sampling  rate  of 
the  A/D  should  be  set  properly. 

Sampling.  During  the  sampling  phase,  the 
start  signal  is  given  and  the  A/D  (analog-to- 
digital  converter)  takes  eight  samples  of  the 
input  signal  i(t)  i  These  eight  samples  are 
stored  in  the  scratchpad  memory  and  are  accu¬ 
mulated  in  register  AO.  After  all  eight 
values  have  been  added  to  AO,  the  register  is 
shifted  three  places  (divide  by  8);  register 
AO  may  now  be  used  to  remove  the  average  value 
component  (Wal(0,8))  from  the  input  signal. 


Transient  Response.  At  this  point  the 
input  signal  has  been  properly  conditioned  for 
use  in  registers  Al  and  A2.  The  resonant 
filter  has  Al  ■  A2  “  0  which  causes  a  transient 
response  as  the  input  signal  is  applied.  The 
filter  is  allowed  one  cycle  over  the  eight 
input  values  to  allow  the  transient  response 
to  die. 

Sign  Detection.  Once  the  transient 
response  has  died,  the  filter  rims  one  more 
cycle  over  the  eight  input  values  while  the 
sign  bits  of  register  Al  and  A2  are  used  to 
fill  the  sign  register.  At  the  completion  of 
this  cycle,  the  match  signal  goes  to  "one"  if 
the  tuned  Walsh  function  was  present  in  the 
input  signal. 

Theory  of  Operation 

The  principle  upon  which  the  filter  is 
based  follows:  if  the  tuning  bit  is  zero: 

x(n)  «  x(n-l)  +  i(n)  -  AO 

y(n)  »  y(n-l) ; 
if  the  tuning  bit  is  one: 

x(n)  -  y(n-l) 

y(n)  -  x(n-l)  +  i(n)  -  AO. 

Rather  than  switch  the  values  of  x(n)  and  y(n) 
back  and  forth  between  Al  and  A2,  the  input 
samples  i(n)  n re  switched  to  either  Al  or  A2  as 
required.  The  sign  of  x(n)  may  be  used  for 
detection  a3  will  be  shown  in  the  following 
simulation. 

BASIC  Simulation 

A  simulation  of  the  digital  resonant 
sequency  filter  of  Figure  3  has  been  written 
in  BASIC  and  is  shown  in  Table  2.  The  simu¬ 
lation  uses  the  tuning  words  listed  in  Table  1. 
Four  example  runs  of  the  simuletlon  with  the 
filter  tuned  to  Cal(l,8)  are  shown  to  verify 
the  theory  of  operation. 


Case  1. 


Cal(l,6) ,  Tuned:  Csl(l,0) 


Transient 

Response 

Phase 


Sign 

Detection 

Phase 
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/ 

l 

I 


Case  2.  Input:  Cal(2,6),  Tuned:  Cal(l,8) 

n  i(n) 

8  1 

9  1 

10  -1 

11  -1 

12  1 

13  1 

14  -1 

15  -1 

16  1 

Case  3.  Input:  2Sal(2,8)  +  3881(3,8), 
Tuned:  Cal(l,8) 

n  i(n)  x(n) 

8  1 

9  -1 

10  5 

11  1 

12  -5 

13  5 

14  -1 

15  -5 

16  1 


6 


Case  4. 

Input : 

1  Wal(i,8), 
i-1 

Tuned:  Cal(l,8) 

n 

i(n) 

x(n) 

8 

0 

-4 - 

9 

-2 

-6 

10 

0 

4 

Sign 

11 

-2 

2 

Detection 

12 

0 

2 

Phase 

13 

6 

8 

14 

0 

—6 

15 

-2 

-8 

16 

0 

-6 

Cases  1  and  4  have  Inputs  containing 
Cal(l,8)  and  the  sign  detection  phase  shows 
that  a  match  does  Indeed  occur.  However,  in 
cases  2  and  3,  Cal(l,8)  is  not  present  in  the 
input  signal  so  a  match  does  not  occur. 

Conclusion 

This  paper  has  presented  a  special-purpose 
digital  implementation  of  a  resonant  sequency 
filter.  The  design  has  been  verified  through 
simulation  using  the  BASIC  language.  The  filter 
implementation  may  be  used  to  detect  the  pres¬ 
ence  of  a  Walsh  function  in  sequence  of  eight 
contiguous  samples  of  the  input  signal  to  the 
A/D.  The  design  may  be  easily  extended  to 
handle  Walsh  functions  of  higher-order. 


0 

-1 

0  Sign 
1  Detection 
-4  Phase 


x(n) 

0 — 

1 

0  Sign 
-1  Detection 
0  Phase 
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Start/Stop  ■  • 

Fig.  3.  Digital  Resonant  Sequency  Filter 


Tnble  1.  Tuning  and  Matching  Word* 


Wal(0,6)  0000  00000000 

Sal(l, 0)  0001  11110000 

CaKl.fl)  0100  11000011 

Sal(2,e)  0101  00110011 

Cal(2,6)  1010  01100110 

Sal(3,9)  1011  10010110 

Cal(3,0)  1110  10100101 

Sal(4,e)  1111  01010101 


Table  2.  BASIC  Simulation 


10  REM  SEQUENCY  FILTER  SIMULATION 
20  REM  CALI  THRU  CAL4  FILTERS 
30  REM  S(l)  THRU  S(8)  ARE  TUN IMG  CONSTANTS 

40  REM  1(1)  THRU  1(8)  ARE  INPUT  SIGNAL 

VALUES 

50  DIM  S(8),I(8) 

60  PRINT  "FILTER  CASE 
70  INPUT  C 

90  PRINT  "INPUT  4  TUNING  BITS" 

100  FOR  N-l  TO  4 
110  INPUT  S(N) 

115  S(Nf4)-S(N) 

120  NEXT  N 
130  PRINT 
135  T-0 

140  PRINT  "TYPE  8  INPUT  SIGNALS" 

150  FOR  N-l  TO  8 
160  INPUT  I(N) 

165  T-T+I(N) 

170  NEXT  N 
180  T-T/8 
200  Yl-0 

205  PRINT 

206  PRINT 
210  Xl-0 

220  PRINT  "SIMULATION  BEGINS" 

230  PRINT 

280  PRINT  "NIX  Y" 

290  PRINT 

300  FOR  M-l  TO  2 

310  FOR  N-l  TO  8 

320  IF  S(N)-0  THEN  350 

330  X-Yl 

335  Y-X1+I(N)-T 

340  CO  TO  360 

350  X«X1+I(N)-T 

355  Y-Yl 

360  PRINT  N;I(N) ;X;Y 

365  Yl-Y 

370  Xl-X 

380  NEXT  N 

410  NEXT  M 

420  GO  TO  135 

999  END 
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Abstract 


It  Is  well  known  that  the  fast  Hadamard 
transform  Is  computationally  advantageous  over 
the  fast  Fourier  transform  for  filtering  opera¬ 
tions;  however,  more  design  Information  Is  avail¬ 
able  for  the  frequency  domain  than  for  the  rel¬ 
atively  recent  sequency  domain.  To  take  advan¬ 
tage  of  both  the  simple  design  techniques  of  the 
fast  Fourier  transform  and  the  decreased  computa¬ 
tion  time  of  the  fast  Hadamard  transform,  the 
following  problem  Is  considered:  Given  the  dis¬ 
crete  Fourier  transform  of  a  desired  filter,  de¬ 
rive  an  equivalent  Hadamard  sequency  filter. 

This  problem  Is  solved  for  one  dimensional  fil¬ 
ters. 


The  solution  consists  of  deriving  a  rela¬ 
tion  between  the  frequency  and  sequency  domain 
filters  and  then  showing  that  the  equivalent 
sequence  filters  may  actually  be  Implemented 
with  the  fast  Hadamard  transform. 

Examples  of  equivalent  filtering  of  signals 
are  given.  The  cost  of  the  equivalence  filter¬ 
ing  Is  that  the  normal  scalor  multiplication  may 
be  increased  to  vector  multiplication;  however. 
It  Is  possible  to  maintain  an  efficient  computa¬ 
tion  for  certain  cases. 

Introduction 


In  the  next  section,  equivalent  Hadamard 
transform  filtering  Is  described.  Then  computa 
tlonal  problems  are  considered. 


The  block  diagram  of  a  Fourier  filtering 
system  is  shown  In  Fig.  1.  For  a  one-dimension¬ 
al  system,  the  Input  column  vector,  s,  is  first 
discrete  Fourier  (DR)  transformed,  producing 
the  DFT  of  s.  Next,  a  point-by-point  multipli¬ 
cation  In  the  frequency  domain  Is  performed. 
Finally,  the  Inverse  Fourier  transform  of  the 
filtered  Input  transform  Is  computed  to  produce 
the  output  column  vector,  r.  Thus,  In  matrix 

form:  rj  =  F'^Fs  (1) 


where  r,  and  s  are  N  length  column  vectors, 

-jZir 

F  *yJtWnk],  W  =  e  ,  F_1  =  F*.  N  =  2m  (2) 


and  G,  Is  an  N  x  N  filter  matrix  whose  terms  are 
the  filter  weights.  If  only  the  diagonal  terms 
of  G,  are  non-zero  the  filter  Is  called  a  scalor 
filter  [1],  If  at  least  one  off  diagonal  term 
Is  non-zero,  the  operation  is  referred  to  as 
vector  filtering.  For  most  cases  a  real  scalor 
filter  is  desired  thus  G1  must  be  conjugate 
symmetric,  l.e..  If  g0,  gi,  ...  gN-1  are  the 
diagonal  elements  of  G^  then  g^  =  gN-1  for  i  »1, 
...(N/2-1). 


It  Is  well-known  that  the  fast  Hadamard 
transform  Is  computationally  advantageous  over 
the  fast  Fourier  transform.  However,  the 
Hadamard  transform  filters  are  not  as  easy  to 
design  as  simple  frequency  domain  fast  Fourier 
transform  filters.  To  take  advantage  of  both 
the  simple  design  techniques  of  the  fast  Fourier 
transform  and  the  decreased  computation  time  of 
the  Hadamard  transform  or  recursive  filter,  the 
following  problem  Is  considered:  given  the  dis¬ 
crete  Fourier  transform  of  a  desired  spatial 
filter,  derive  an  equivalent  Hadamard  sequency 
filter. 

Pratt  [1]  has  shown  that  discrete  Weiner 
Filtering  may  be  Implemented  by  any  unitary 
transformation,  rather  than  just  the  Fourier 
transform. 

The  purpose  of  this  paper  Is  to  describe 
methods  for  designing  Hadamard  transform  filters 
given  the  equl-spaced  discrete  frequency  domain 
specifications.  This  solution  allows  one  to  use 
the  fast  Fourier  transform  for  experimentation 
with  the  design  of  a  digital  filter  for  signal 
enhancement,  then  Implement  the  filter  with  a 
faster  computational  method. 


Now  consider  the  problem  of  determining  a 
Hadamard  transform  filter.  Go,  which  performs  an 
equivalent  operation  as  the  Fourier  transform 
filter,  G^ 

Equivalent  Hadamard  Filter 

A  large  amount  of  filter  design  Information 
for  filtering  signal  via  the  fast  Fourier  trans¬ 
form  Is  available;  [2,3];  however,  Hadamard 
transform  sequency  filtering  Is  relatively  new, 
[4,5].  Therefore,  Implementing  a  frequency  do¬ 
main  filter  via  a  sequency  domain  computation  is 
economical  in  both  design  and  computation  time. 

The  block  diagram  of  a  filtering  system 
using  the  Hadamard  transform  is  shown  In  Fig.  2. 
Again  for  the  one-dimensional  case,  s  and  r  are 
N  x  1  column  vectors  and 
*  H*'G2Hs 
where  [1] 

H  -  HN  P.H*1  »  H 
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N  =  2m 


wi  re  P  Is  a  row  permutation  matrix  and  G2  Is 
an  N  x  N  filter  matrix.  For  scalar  filtering 
the  diagonal  terms  are  the  filter  weights  and 
the  off  diagonal  terms  are  zero. 


If  equivalent  outputs  are  to  be  produced 
by  both  the  Fourier  and  Hadamard  systems,  then 

rl  "  r2  or: 

F"1G,Fs  =  H_1G2Hs 
HF'Ws  =  HH_1G2Hs  =  G2Hs 
Therefore: 

hf'^f  =  g2h 
or 

G2  =  HF'^FH'1  =  HF*G1FH 

Clearly  the  two  filtering  results  are  the 
same,  l.e. 

r2  *  H'^GgH  =  H"1HF"1G1FH*^H  =  F'^F  *  r, 


It  Is  Interesting  to  investigate  the 
conditions  previously  Imposed  on  G2,  l.e.,  that 
it  be  a  real,  diagonal  matrix  for  scalar  filter¬ 
ing. 


An  example  of  the  equivalent  Hadamard  fil¬ 
ter  computation  for  i1=4  is  shown  in  Fig.  3  and 
illustrates  that  the  G?  matrix  is  not  neces¬ 
sarily  diagonal.  In  the  example  G2  may  be 
transformed  Into  a  diagonal  matrix  simply  by 
row  or  column  transformations. 


In  general,  Go.ls  always  dl agonal izable 
which  may  be  seen  from  the  following  argument. 

Let  P  =  F^GjF  or  G]  «■  FPF'1 

then  since  F  Is  a  non-singular  matrix,  P  and  Gj 
are  similar  [3].  flow  since  G-j  is  a  diagonal 
matrlce,  the  characteristic  roots  are  simply 
the  diagonal  elements.  Furthermore,  since  P 
and  Gi  are  similar,  they  have  the  same  charac¬ 
teristic  roots. 

Now  G2  a  HPH”^  and  since  H  Is  non  singular, 
G2  and  P  are  similar.  Thus,  Gj  and  G2  have  the 
same  characteristic  roots.  Finally,  since  G2 
is  similar  to  a  diagonal  matrix  It  is  dlagonall- 
zable. 


Note  that  If  62  is  not  a  real,  diagonal 
matrix,  then  the  speed  of  computation  may  be 
greatly  affected.  For  example,  the  point  by 
point  multiplication  of  N  points  may  have  to  be 
replaced  by  an  NxN  matrix  computation.  On  the 
other  hand.  If  Gg  Is  not  a  diagonal  matrix  but 


has  a  large  number  of  zero  elements,  an  effi¬ 
cient  computation  Is  possible. 

Figure  4  shows  an  8  point  example.  In 
this  example  a  unity  filter  was  used.  As  It 
can  be  seen,  the  result  of  filtering  In  both 
domains  Is  equal.  The  slight  difference  be¬ 
tween  the  numbers  Is  the  roundoff  error.  In 
Fig.  5  a  band  reject  filter  was  used.  A 
signal ,f(nT)  =  sin  2m3nt  +  sin  2it4nT,  n*0,..., 
15  and  T=1/16  was  filtered  of  its  3  and  4  H 
comnonents. 

Figure  6  is  the  printout  of  the  Fourier 
domain  filter.  Figure  7  shows  the  Walsh 
filter  matrix.  Fig.  8  is  the  time  domain  re¬ 
presentation  of  f(nT). 

Figure  9  is  the  result  of  filtering  in  the 
Fourier  domain.  As  it  can  be  noticed,  the 
amplitude  of  the  filtered  signal  Is  very  low. 

It  Is  not  completely  zero  due  to  Gibbs 
phenomena.  Fig.  10  Is  the  Walsh  domain 
filtered  signal.  It  Is  exactly  equal  to  the 
signal  In  Fig.  9. 

Figure  11  shows  another  example  where  the 
Input  was  a  series  of  Impulses.  Figure  12 
shows  the  low  pass  filter  used.  Fig.  13  shows 
the  Fourier  filter  terms  and  Fig.  14  shows  the 
corresponding  Walsh  filter  terms.  Figure  15  Is 
the  Fourier  domain  filter  signal  of  Fig.  11. 
Fig.  16  Is  the  Walsh  domain  filtered  signal. 

As  It  can  be  seen  again.  Fig.  15  and  Fig.  16 
are  exactly  the  same. 
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Fig.  3.  Example  of  equivalent  filter  computation  for  N«4. 
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Note  that  P  is  Hermetian,  i.e.y  .  «  P^*.  Furthermore,  if  o  is  synntetric  conjugate,  i.e., 

9]  3  93*  *  a+jb  then  (jgi-jg3)  ■  -cb  *hiih  is  real  so  that  P  is  real,  since  both  go  and  go  are  also 
real.  Under  the  symmetric  conjugate  condition  on  g,  P  reduces  to 


P  » 


1 

T 


where 


-land  all 


b0  *  90+9l+92<93 
*  go“9l+92'93 
b2  *  g0'92-^9rg3} 

fa3  *  90’92+^9rS3) 
are  real. 


Note  also  that  four  g^  values  produce  only  four  values. 


Finally,  note  that 


i 
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b0+b1+b2+b3  -  4^ 

VWb3  3  4<52 

b0»b1+b2-b3  -  ?g1(1-Jl)+2g3{1+j1) 

b0-brb2+b3  *>  2g1(Hj)+2g3<l-j) 
Kow  let  us  compute  G2  *  HPH,  <.e. 
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Thus,  G,  Is  not  diagonal.  However,  If  b*0, 
G2  is  diagonal. 


ARBITRARY  INPUTS  TO  THE  FILTET : 
riNPUT*(J,l  -1 ,1 ,5, 5 ,5, 5) 


FOURIER  DOMAIN  flLTER  WEIGHTS 


1  0  0  n  0  0  0  0 
0! DOOOOO 
n  0  i  0  0  0  0  n 
00010000 
00001000 
000001  00 
ooooooi  0 
00000001 


EQUIVALENT  WAISII  DOMAIN 


15.62 
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15.62 
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O.P 
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0.0 

0.0 
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0.0 

0.0 

0.0 
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0.0 

0.0 
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0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

FILTER  WEIGHTS  (xlPOO) 


O.P 

0.0 

0.0 

0.0 

O.P 
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0.0 
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0.0 

O.P 
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0.0 

0.0 
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15.62 

RESULT  or  niTERIHR  IN  rOURIEr  DOMAIN 
r0UT»(1,0,l. 0,1.0, 1.0, 5,0,5.", 5.0, 5.0) 


RESULT  OF  FILTERING  IN  WALSH  DOMAIN 


F0UT*(1, 0,1. 0,1. 0,1, 0,5.0, 5.0, 5.0.5.0) 

Mg.  4.  Eight  point  filtering  with  unity 
gain  filter. 
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Fig.  5.  Sixteen  point  filter  function 
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Fig.  6.  Fourier  domain  filter  weights 
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Fig. 

7.  Equivalent  Walsh  domain  filter 
w  <ghts  (xIOOO). 
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Fig.  13.  Fourier  domain  filter  weights. 
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EQUIVALENT  WALSH  DOMAIN  FILTER  WEIGHTS  (xlOOO) 

3.91  O.C  0.0  0.0  0.0  0.0  0.0  G.O  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0 

0.0  3.78  0.0  0.0  0.0  0.05  0.0  0.0  0.0  -.26  0.0  0.0  0.0  -.64  0.:  0.0 

0.0  0.0  3.78  0.0  0.0  0.0  -.05  0.0  0.0  0.0  -.26  0.0  0.0  0.0  .64  0.0 

0.0  0.0  0.0  3.33  0.0  0.0  0.0  0.0  0.0  0.0  0.0  -1.38  0.0  0.0  0.0  0.0 

0.0  0.0  0.0  0.0  3.33  0.0  0.0  0.0  0.0  0.0  0.0  0.0  1.38  0.0  0.0  0.0 

0.0  0.05  0.0  0.0  0.0  3.88  0.0  0.0  0.0  0-11  0.0  0.0  0.0  0.26  0.0  0.0 

0.0  0.0  0.05  0.0  0.0  0.0  3.88  0.0  0.0  0.0  -.1)  0.0  0.0  0.0  0.26  0.0 
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0.0  0.0  -.25  0.0  0.0  0.0  -.11  0.0  0.0  0.0  3.36  0.0  0.0  0.0  1.33  0.0 

0.0  0.0  0.0  -1.38  0.0  0.0,  0..0  0.0  0.0  0.0  0.0  0.57  0.0  0.0  0.0  0.0 
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0.0  -.64  0.0  0.0  0.0  0.26  0.0  0.0  0.0  -1.33  0.0  0.0  0.0  0.7  0.0  0.0 

0.0  0.0  0.64  0.0  0.0  0.0  0.2C  0.0  0.0  0.0  1.33  O.C  0.0  0.0  0.7  0.0 

0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0  0.0 


Fig.  14.  Equivalent  Walsh  domain  filter 
weights  (xlOOO). 
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WAVEFORM  ANALYSIS  OF  IMAGE  SIGNALS  BY  0RTH060NAL  TRANSFORMATION 

Kosho  Shibata 
KDD  Research  Laboratory 
Tokyo, Japan 


Abstract  -  By  a  computer  simulation,  properties  of 
block  waveforms  for  sampled  video  signals  were  examined 
by  the  use  of  an  orthogonal  transformation,  and  possibility 
in  compressing  frequency  bandwidth  was  examined.  As  a 
result,  it  was  found  that  most  of  finely  divided  portions  of 
an  image  are  comparatively  simple,  number  of  types  is 
limited,  and  that  they  appear  on  particular  waveforms 
frequently.  In  Uhe  case  of  a  16th  order  orthogonal 
transformation  in  a  2-dimensional  array,  when  block  wave¬ 
forms  of  an  image  are  expressed  ir.  approximately  1000 
types,  Sp-p/Nr.m.s  is  approximately  33  dB,  a..  ’  coding  is 
considered  possible  at  an  average  of  1 .5  bit/sample. 

Introduction 

Various  studies  to  process  images  by  the  use  of  an 
orthogonal  transformation  have  been  reported.1)2)4)  It 
seems  that  the  people  concerned  have  used  individual 
statistical  properties  of  transformation  outputs  to  properly 
quantize  orthogonal  transformation  output. 

In  this  paper,  however,  examination  was  made  by  using 
relation  among  individual  transformation  outputs.  Waveforms 
of  fine  blocks  of  a  video  signal  were  expressed  in  a 
normalized  waveform  pattern  by  the  use  of  an  orthogonal 
transformation  and  the  normalized  waveform  patterns  were 
examined  by  a  computer  simulation.  As  the  result,  it  is 
understood  that  types  of  these  patterns  are  limited  and  they 
tend  to  appear  frequently  on  limited  number  of  particular 
waveforms.  It  is  expected  that  these  properties  of  waveform 
pattern  may  be  used  effectively  in  coding  video  signals 
efficiently  as  well  as  the  various  properties  for  video  signal 
such  as  correlation  between  picture  elements,  prediction 
error  of  previous  value  or  linear  prediction  error  level 
distribution,  and  frequency  spectrum  distribution. 

In  the  following,  the  orthogonal  transformation,  nor¬ 
malized  waveform  pattern  for  block  signal  waveform,  method 
of  computer  simulation,  the  results  and  discussions  therefore 
are  described. 

Orthogonal  Transform1^)4) 

2-dimensional  orthogonal  transform  of  a  sample  data 
Xjj|  (h*l~8,  i=l~m)  is  expressed  as  equation  (1).  In  the 
case  of  a  1 -dimensional  transform,  however,  it  may  be  ex¬ 
pressed  as  equation  (2)  because  a  transformation  output  is 
generally  used  in  the  form  of  a  transpose. 


where, 

Sa2-1,  S  bfo-l, 

i*l  Jl  h-1  *n 

|,afiagi  =  °’  h|,  bfh  °gh  =  0 

where 

xjj:  Element  of  input  signal  data  £,  m  matrix  * 
'■  x^j  Element  of  transpose  matrix  of  x^;  x{^=  Xjj, 
yjjj:  Element  of  orthogonal  transformation  output  8,  m 

matrix  (j=i 

aj j :  Element  of  mth  order  orthogonal  matrix 

by,:  Element  of  Bth  order  orthogonal  matrixjby,  =  bj^ 

Now,  when  4th  order  slant  orthogonal  matrix  MH2S  is 
used  for  the  orthogonal  matrix  to  indicate  2-dimensional 
orthogonal  transform,  it  is  indicated  as  equation  (3). 
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Fig.  1  shows  waveforms  lined  up  in  the  sequence  of 
this  transform  after  extending  the  2-dimensional  method  to 

1- line  method. 

Among  these  wave  forms,  ho, ,  h02,h()l,h(l],  and  ho« 
respectively  indicate  DC  component,  inclination  toward 
vertical  direction  inclination  toward  horizontal  direction, 
horizontal  line  and  vertical  tine.  In  the  case  of  a  1 6th  order 

2- dimensional  Hadamard  transform,  positive  and  negative 
ones  in  the  Fig.  1  may  respectively  be  expressed  in  1  and 
-I.  Moreover,  equation  (4)  indicates  relation  between  4th 
order  Hadamard  transformation  output  y0j  and  slant 
orthogonal  transformation  output  yj. 

y*  ^(2y01  +  yo«) 

y4-^(-y«, +2yw)  W 


yW  =  h«l  i«i  bkhxhi,ji  0) 

yjk=  h?i  j?j  *ji  xhibkh  (2) 


Hence,  a  riant  orthogonal  transform  can  be  obtained 
easily  from  Hadamard  transformation  output.  Equation  (5) 
shows  an  8th  order  1-Une  slant  orthogonal  matrix  MH1, 
and  equation  (6)  indicates  relation  between  transformation 
output  yj  of  this  MH1  and  8th  order  Hadamard  transform¬ 
ation  output  y0j. 
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Fig.  1  Waveforms  of  16th  ordc-  2-  -nensional 
slant  transform  matrix 
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Waveform  Pattern 

Hie  orthogonal  transform  may  be  considered  as  a  sort 
of  waveform  analysis.  Input  signal  waveform  is  analyzed  by 
orthogonal  waveforms,  and  it  is  expressed  in  the  form  of  an 
output  of  the  waveform  components,  in  other  words,  as  an 


output  of  orthogonal  transform.  Thus,  input  signal  wave¬ 
form  is  regulated  depending  upon  a  relation  among  the 
transformation  outputs.  Now,  in  the  case  of  an  nth  order 
orthogonal  transform  y,  out  of  n  transformation  outputs 
represents  DC  component  of  the  input  sample  waveform. 
Hence,  waveform  components  excluding  the  DC  component 
are  indicated  by  yj  other  than  y,.  Therefore,  when  one 
absolute  value  of  which  is  maximum  is  expressed  ym,  the 
yj  is  normalized  with  the  ym  to  obtain  yj/ym  and  yj/ym  in 
quantity  of  (n-1)  are  treated  as  one,  relation  among 
transformation  outputs  can  be  regulated.  This  is  considered 
as  a  normalized  waveform.  Quantized  waveform  pattern  can 
be  obtained  by  quantizing  this  normalized  waveform  at 
proper  levels  such  as  0,  ±1/3,  ±2/3  and  ±1.  This  means  that 
input  block  waveform  is  expressed  in  the  form  of  a 
normalized  pattern.  Hereinafter,  this  pattern  is  called 
waveform  pattern.  This  waveform  pattern  corresponds  to 
input  signal  waveform  in  one  to  one.  Thus,  input  signal  can 
be  recovered  from  this  waveform  pattern.  To  oe  more 
specifically,  input  signal  can  be  obtained  by  multiplying  yj„ 
(quantized  ym)  to  normalized  pattern  to  obtain  each  yj 
(quantized  yj)  and  by  conducting  inverse  orthogonal  trans¬ 
form  on  it  after  adding  yj  (quantized  y, ). 

Computer  Simulation 
Method  of  simulation 

In  order  to  examine  properties  of  block  waveforms  of 
a  video  signal,  various  examinations  were  made  by  obtain¬ 
ing -waveform  patterns  on  waveforms  of  three  types  of 
input  signal  data  block  1  x  8,  2  x  4  and  4  x  4  arranged  on 
a  straight  line  and  plane.  For  the  orthogonal  transformation 
matrices,  2nd,  4th  and  8th  order  Hadamard  matrices  H2, 
H4  and  H*  and  4th  order  slant  matrix  MH2S  and  8th  order 
slant  matrix  MHI  were  used. 

For  the  input  video  signals,  three  types  of  signal  data 
A,  B  and  C  obtained  from  three  types  of  SMPTE  slides;  (A) 
close-up,  (B)  medium  and  (C)  fine  picture  were  used.  The 
dynamic  range  is  from  0  to  63,  quantizing  in  64  levels.  For 
the  data  A,  numbers  of  blocks  for  8th  and  16th  orders  are 
respectively  2464  and  1232,  for  the  data  B,  3315  and 
1536,  and  for  data  C,  3087  and  1440. 

Fust  of  all,  orthogonal  transform  was  conducted  on 
each  block  of  input  data  by  the  use  of  H,  MHI  for  the  8th 
order  straight  arrangement  to  obtain  maximum  value  ym  of 
transformation  output  other  than  DC  component  and  ratio 
of  (yi/ym);  waveform  pattern  (Yj/ym )'  (j*2~8)  was  ob¬ 
tained  by  quantizing  it;  and  thus,  types  and  appearance 
frequency  were  obtained.  Amplitude  distribution  of  ym, 
ratio  ym/y,  and  frequency  on  each  yj  of  ym  were  also 
obtained.  A  degree  of  waveform  distortion  due  to  quantiz¬ 
ing  was  examined  by  obtaining  quantizing  noise.  For  the 
quantizing  noise,  yj,,  obtained  by  quantizing  ym  was 
multiplied  to  the  waveform  pattern  to  obtain  yj  (j*2~n); 
yj  obtained  by  quantizing  y ,  was  added  to  it  to  conduct  in¬ 
verse  orthogonal  transform,  recovery  signal  xj  was  thus  ob¬ 
tained;  mean  square  error  of  quantization  was  obtained  with 
difference  between  the  recovery  signal  xj  and  input  signal 
X|;  and  thus,  Sp-p/Nj.ig.s  ajm  obtained.  jn  addtion,  linear 
prediction  error  Cxj  =  -fcJ  *  *j  of  input  data  Xj  was 

obtained,  and  Sp-p/Nr.m.s  of  the  quantizing  error  against 
the  value  of  Sxj  was  obtained.  For  the  case  of  8th  order, 
yt  and  ym  were  respectively  quantized  by  7  and  5  bits. 
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and  yj/yra  was  quantized  with  0,  ±1/3,  ±2/3  and  ±1  after 
making  yj  zero  under  the  following  provisions: 

Fory,  ~y4  :  yjd 

Fory,  ~y,  :  ty<2 

In  the  caae  of  16th  order,  y,  and  ym  were  quantized 
with  eight  and  six  bits,  and  as  for  y3~y!4,  y}  was  made  to 
zero  when  yjCl;  and  thus,  yi/ym  was  quantized  in  the 
same  manner  as  the  case  of  8th  order.  As  for  2-line  array 
data  of  8th  order,  when  transformation  matrix  is  a 
Hadamaid  matrix,  (H4,  HJ)  was  examined,  and  MH2 
(MH2S,  H*)  was  examined  in  the  case  of  2-line  inclination, 
both  in  the  approximately  same  manner  as  the  case  of 
1-line  array.  In  addition,  for  16th  order  4-line  array  data, 
(H4,  H4)  was  examined  when  transformation  matrix  is 
Hadamard,  and  (MH2S,  MH2S)  was  examined  in  the  case  of 
plane  inclination  for  the  same  matters. 

Result  of  simulation  and  discussion 
(1)  Result  of  simulation  on  H,  MH1 

For  video  data  A,  B,  and  C  under  linear  array,  8th 
order  slant  orthogonal  transform  MHl  was  examined.  Fig.  2 
shows  relative  level  distribution  of  ratio  ym/y,  between 
block  DC  component  y,  and  maximum  change  component 
ym,  and  Fig.  3  shows  percentage  of  ym  appearance 
frequency  on  cadi  yj.  Distributions  of  ym/yi  for  three  data 
are  mutually  similar.  In  the  case  of  A  (close-up),  however, 
zero  appears  remarkably  frequently,  the  overall  value  is 
smaller  than  that  of  B  and  C  data,  and  it  reveals  a  tendency 


Fig.  2  Distribution  of  ratio  ym/y  | 
(Horizontal  axis:  Probability 
density,  XHT1) 
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Fig.  3  Percentage  of  appearance  frequency 
of  ym  on  each  yj 


that  values  are  greater  in  the  order  of  B  and  C  data.  As  for 
percentage  of  ym  on  each  transformation  output,  y3 
appears  most  frequently  (approximately  40%)  for  all  A,  B 
and  C  data,  y*  is  approximately  10%,  and  for  other  yj,  it 
rapidly  reduces  as  j  increases.  This  means  that,  as  far  as 
picture  is  concerned,  component  which  frequently  fluctu¬ 
ates  is  very  minor.  Fig.  4  and  5  respectively  mow  level 
distribution  of  overall  ym,  and  level  distribution  of  ym 
where  ym  is  separated  to  each  y«.  In  the  Fig.  4,  levels  are 
higher  in  the  order  of  A,  B  and  C.  In  the  Fig.  5,  amplitude 
level  of  ym  reduces  as  j  of  y:  increases;  frequency  at  low 
level  is  remarkable  for  A;  and  B  and  C  are  mutually  similar. 
As  it  is  expressed  in  the  Fig.  3,  ym  does  not  appear  so 
frequently  where  j  is  great;  amplitude  is  small;  and  also  for 
the  matter  of  frequency,  component  is  extremely  high. 
Thus,  it  may  be  disregarded  in  processing  video  signal. 


Fig.  4  Level  distribution  of  ym 

(Horizontal  axis:  Probability  density,  XHT1) 


Fig.  6  shows  Sp-p/Nrm  s  against  linear  prediction 
error  on  H  and  MHl,  together  with  the  ordinary 
Sp-p/Nrm  s.  When  linear  prediction  error  is  zero,  MHl  is 
approximately  l.S  dB  better  than  H,  it  is  approximately 
4.5  dB  better  than  ordinary  ones,  and  it  indicates  that 
quantizing  noise  is  small  where  fluctuation  is  minor. 
Moreover,  this  indicates  that  inclination  component  can  be 
easily  expressed  by  uring  slant  orthogonal  matrix.  Signal- 
to-noise  ratio  is  considerably  worsened  at  a  part  where 
linear  prediction  error  is  large,  and  it  is  considered  that  this 
may  not  be  regarded  because  of  the  visual  characteristics. 
However,  care  should  be  exercised  on  error  in  edge 
position. 

(2)  Property  of  waveform  pattern 

For  H  and  MHl  of  8th  order  1-iine  array,  H  and  MH2 
of  8th  order  2-line  array  and  H  and  MH2S  of  16th  order 
4-Une  array.  Table  1  shows  number  of  appeared  waveform 
patterns,  Sp-p/Nr.m.t  and  number  of  input  blocks  for  A,  B 
and  C,  and  the  grand  total.  The  value  of  Sp-p/Nrjn.s  is 
applicable  for  the  case  in  which  signal  is  reproduced  to  the 
original  signal  by  using  appeared  waveform  pattern. 


Fig.  5 


Level  distribution  of  ym  on  each  y-. 
(Vertical  axis:  Probability  density ,  xlO"1) 
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When  the  H  of  the  8th  order  1-line  array  is  compared 
to  the  MH1  of  the  same  based  cn  the  Table  1,  pattern 
appears  less  frequently  for  the  MH1  throughout  the  data  A, 
B  and  C  and  the  MH1  is  slightly  better  than  the  H  In 
Sp-p/Nr.m  s  for  the  data  A  and  B,  but  for  the  data  C  (fine 
picture),  the  H  is  slightly  better  than  the  MH1.  As  long  as 
number  of  patterns  is  concerned,  the  MI12  is  slightly  less 
than  the  H  also  for  the  case  of  2-line  array,  and 
signal -to-noise  ratio  is  also  improved  slightly.  As  for  the 
companion  between  1-line  array  and  2-line  array,  number 
of  waveform  patterns  considerably  reduces  and  signal- 
-to-noise  ratio  is  slightly  improved. 


Table  I  Number  of  types  of  waveform  pattern  and  $/N 
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For  the  H  and  MH1  of  8th  order  1-line,  H  and  MH2 
of  8th  order  2-line  array,  and  H  and  MH2S  of  16th  order 
2-dimensional  army  on  the  data  A,  accumulation  percen¬ 
tages  were  obtained  in  order  of  higher  waveform  pattern 
appearing  frequency.  Fig.  7  shows  the  accumulation  percen¬ 
tages  for  the  number  of  waveform  patterns  obtained  as 
above. 

For  all  cases,  it  is  common  that  the  pattern  appears 
most  frequently  when  input  (waveform  O^/h^,)’  of  which  is 
zero)  is  flat.  In  the  1-line  array,  flat  ones  are  only  40%,  but 
it  increases  to  approximately  60%  under  2-dimensional 
array.  Moreover,  for  both  the  2-line  and  4-line  arrays, 
Hadsmard  matrix  is  almost  similar  to  slant  matrix  for  the 
matter  of  accumulated  percentage  of  pattern  is  concerned. 
However,  in  the  Nine  array,  the  slant  matrix  is  highly 
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Fig.  6  Sp-p/Nr  jn  j  for  linear  prediction  error  of  xj 
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Fig.  7  Accumulated  appearance  frequency  of 
pattern  for  number  of  patterns 


'concentrated,  in  companion  with  Hadamard  matrix,  at  a 
portion  where  number  of  patterns  is  small.  For  the  data  A, 
16  patterns  having  higher  appearance  frequency  were 
selected  from  those  on  the  8th  order  I-line  MH1.  Fig.  8 
shows  the  patterns  and  waveforms  selected  in  order  of 
higher  appearance  frequency.  According  to  the  patterns 
shown  on  the  Fig.  8,  y*/ym  through  y*/ym  are  all  zero, 
and  throughout  the  patterns,  number  of  zeros  is  extremely 
many.  Majority  of  waveform  patterns  carry  zeros  in  their 
last  two  or  three  positions.  When  observing  each  pattern, 
appearance  frequency  of  pattern  (0,0,0, 0,0, 0,0)  occupies 
42.3%,  slant  portion  (1,0, 0,0, 0,0,0)  is  21.4%,  and  generally 
speaking,  it  may  be  said  that  4  through  16  express  rising 


and  lowering  edges. 
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Fig.  8  Waveform  patterns  and  their  waveforms 


Fig.  9  Accumulateo  appearance  frequency  of 
pattern  for  number  of  patterns 
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(1,0, 0,0, 0,0,0),  (0,1, 0,0, 0,0,0)  and  (0,0,1 ,0,0,0, 0)  which 
correspond  to  waveforms  of  row  vectors  of  transform 
matrix  appear  frequently  in  order  of  1,  2,  3  and  9,  and 
these  four  take  large  percentages. 

Fig.  9  shows  accumulated  appearance  frequencies  for 
number  of  patterns  on  the  data  A,  B,  and  C  for  .the  16th 
order  MH2S  in  the  same  manner  as  the  Fig.  7,  and 
frequencies  of  H  and  MH2S  on  total  of  the  data  A,  8  and 
C.  According  to  the  Fig.  '9,  appearance  frequency  of  flat 
ones  fluctuate  from  40  to  60%  depending  upon  types  of 
input  d?ta,  and  others  indicate  approximately  similar 
tendency  wherein  they  do  not  indicate  remarkable  fluctua¬ 
tion.  The  totals  are  res  jtively  988  and  917,  which 
indicate  that  the  MH2S  is  slightly  less  than  H,  and  when 
examining  the  grand  totals  1 179  and  1207  each  shown  on 
the  Table  1,  it  indicates  reverse  symptom.  It  appears  evenly 
in  portions  where  number  of  patterns  is  minor,  these 
patterns  arc  mutually  common,  and  it  is  assumed  that  when 
number  of  patterns  increases,  number  of  types  of  pattern 
increases  because  they  appear  independently.  Table  2  shows 
16  patterns  which  appear  in  order  of  higher  appearance 
frequency  for  total  of  data  A,  B  and  C.  According  to  the 
Table  2,  those  of  higher  appearance  frequency  are 
extremely  simple,  in  which  all  of  them  have  three  or  less 
quantizing  levels  other  than  zero;  h*t  and  hoi  (Fig.  1) 
which  express  horizontal  and  vertical  inclination  com¬ 
ponents  are  in  (2)  and  (3),  and  ho*  and  h03  which  indicate 
vertical  and  horizontal  lines  are  in  (S)  and  (14).  Most  of 
others  include  horizontal  or  vertical  inclination  com¬ 
ponents.  According  to  the  Table  1,  H  does  not  differ  from 
the  MH2S  as  long  as  noise-to-signal  ratio  is  concerned, 
however,  it  may  be  expected  that  the  2-line  linear,  predic¬ 
tion  error  may  be  improved  slightly. 

(3)  Application  to  video  signal  coding 

It  was  found  that  fine  block  waveform  of  video  signal 
can  be  expressed  in  a  limited  number  within  a  range  in 
which  error  is  not  remarkable.  Now,  for  example  in  the 
case  of  16th  order  orthogonal  transform,  number  of  types 
.of  waveform  pattern  is  limited  to  within  1000,  if  they 
are  coded  at  10  bits,  and  yt  and  ym  are  quantized 
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respectively  at  8  and  6  bits,  total  number  of  bits  is  24,  and 
thus,  1 .5  bit/picture  element  c-.<ding  may  be  possible. 

Quantfeings  to  obtain  waveform  patterns  were  made 
evenly  for  all,  and  it  is  expected  that  signako-noise  ratio 
will  be  improved  by  examining  each  one  of  y^/ym  distribu¬ 
tion  fine’y  and  by  suiting  them  to  the  individual  quantiz¬ 
ing*.  Moreover,  in  the  quantizing,  various  waveforms  pos¬ 
sibly  appear  depending  upon  input  data,  and  therefore, 
clustering  should  be  made  adequately  to  prevent  deteriora¬ 
tion  of  output  image. 

Conclusion 

Block  waveforms  of  three  types  of  video  signals  were 
examined  under  the  normalized  waveform  method  with 
orthogonal  transform.  As  the  result,  it  was  insured  that 
number  of  types  of  appearing  waveform  pattern  is  con¬ 
siderably  limited  and  that  flat  and  slant  portions  occupy  a 
large  percentage.  In  this  study,  mainly  number  of  waveform 
patterns  was  examined.  It  is  considered,  however,  that 
waveform  patterns  which  express  features  of  block  wave¬ 
forms  of  video  signals  can  be  selected  more  precisely  by 
making  quantization  in  response  to  distribution  of  ratio  of 
each  transformation  output  against  the  maximum  value  and 
thus,  video  signal  can  be  coded  efficiently.  In  this  study, 
reproduced  picture  was  evaluated  in  Sp-p/Nr.m  s.  However, 
it  should  be  experimentally  insured  to  prevent  deterioration 
of  quality  of  picture. 
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Introduction 

There  are  a  number  of  Important  photographic 
measurement  techniques  that  must  rely  on  shadow 
Imaging.  These  techniques  Involve  non-optlcal 
radiation  such  as  X-rays,  y-rays  and  neutrons; 
radiation  for  which  lenses  are  not  available. 
Images  of  this  type  are  never  sharply  focused 
and  hence  some  form  of  edge  sharpening  Is 
desirable  In  order  to  be  able  to  make  reliable 
measurements  from  the  photographs.  Such  en¬ 
hancement  has  been  performed  with  coherent 
optical  systems  and  with  computers  £1,2].  The 
optical  systems  are.  In  a  sense,  more  natural 
since  they  are  In  themselves  Image  forming. 
However,  they  are  restricted  to  linear  opera¬ 
tions,  whereas  computers  are  not. 

Computers,  despite  the  fact  that  they  are  not 
restricted  to  linear  processing,  have  for  the 
most  part  been  used  In  a  linear  mode  simply  be¬ 
cause  Imaging  systems  operate  linearly.  Until 
the  rediscovery  of  the  Fast  Fourier  Transform 
algorithm,  picture  processing  was  Impractical 
because  of  the  long  processing  times  required 
[3].  Only  recently  has  attention  been  turned 
to  transforms  other  than  Fourier  for  picture 
processing  [4].  Even  so,  no  real  application 
of  these  transforms  to  picture  processing  has 
been  made;  It  has  only  been  demonstrated  that 
they  can  be  used  to  transform  an  image  and  re¬ 
cover  It  by  the  Inverse  transform. 

In  the  real  world  of  photographic  recording 
we  are  still  restricted  to  the  sine-cosine 
functions.  That  Is,  the  physics  of  wave  propa¬ 
gation  restricts  us  to  Fourier  analysis  rather 
the;',  say.  Walsh  or  Haar  function  analysis.  In 


the  computer  world,  however,  we  would  like  to 
work  with  binary  functions  rather  than  continu¬ 
ous  function.  If  we  can  marry  the  two  worlds, 
we  may  be  able  to  perform  computer  processing 
of  Images  with  simple  matrix  multiplications  in 
place  of  the  more  complicated  FFT  algorithm  at 
a  savings  In  time  and  cost. 

In  this  paper  we  attempt  a  first  step  In 
this  direction  while  aodresslnq  ourselves  to  a 
real  problem.  In  the  nuclear  Industry  a  major 
problem  Is  the  damage  to  fuel  rods  caused  by 
the  Intense  radioactivity  In  the  reactor  core. 
The  way  In  which  this  damage  Is  studied  is  by 
X-ray  or  self  radiation  Imaging.  Since  lenses 
cannot  be  used,  and  point  sources  of  X-ray  are 
not  available,  sharp  shadews  or  edges  are  not 
well  defined  In  the  image.  What  we  wish  to  do 
then  Is  to  sharpen  or  enhance  such  an  Image. 

Optical  Filtering  of  Extended 
Source  Shadow  Images" 

It  Is  well  known  that  coherent  optical  sys¬ 
tems  can  be  used  tc  perform  Fourier  transform 
operations  on  two-dimensional  Input  data  [1]. 
These  systems  are  based  upon  the  observation 
that  a  picture  placed  In  the  front  focal  plane 
of  a  lens  will  have  Its  two-dimensional  Fourier 
transform  displayed  In  the  back  focal  plane. 

A  mask,  varying  In  transmission  and/or  thick¬ 
ness,  placed  in  the  back  focal  plane  can  there¬ 
fore  be  used  to  modify  the  data  In  some  pre¬ 
scribed  manner.  That  Is,  the  Fourier  transform 
of  the  data  can  be  multiplied  by  a  filter 
function  as  Is  customary  In  electronic  systems. 
A  second  lens  can  then  be  used,  to  take  an 
Inverse  transform  to  yield  a  modified  Image. 
Such  a  system  Is  shown  In  Figure  1. 
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Neutron  and  X-ray  Imaging  systems  form  their 
Images  by  shadow  casting  an  energy  absorbing 
object  with  Incoherent  Illumination.  The  size 
of  the  Image  will  depend  on  the  source-to- 
object  and  object- to-recording  plane  distance 
ratio.  If  the  Illuminating  source  dimensions 
approach  or  appear  to  project  from  a  true  geo¬ 
metrical  point,  a  perfect  shadow  of  the  absorb¬ 
ing  object  will  be  obtained  (Figure  2-a)  with 
a  large  Intensity  gradient  along  the  edges. 

If, however,  the  source  appears  to  emanate  from 
a  large  area  composed  of  a  multiple  of  true 
point  sources,  the  Image  edges  will  contain  a 
penumbra  or  unsharpness  with  small  Intensity 
gradients  along  the  edges  (Figure  2-b).  A  one- 
dimensional  analysis  of  the  shadow  Image  Inten¬ 
sity  shows  that  the  image  obtained  from  an 
extended  $ourv.e  Is  the  convolution  of  the 
extended  source  u(s)  with  the  Image  that  would 
be  obtained  from  a  true  point  source  I(x)  [1]. 

»A* 

Ux)  *  C /  rt(B)  I(x-B)  dB  (1) 

*  'A 

where  A,  A*  «re  the  source  dimensions  projected 


to  the  Image  plane,  «(B)  and  I(x)  are  the 
source  Intensity  distribution  and  object  Inten¬ 
sity  transmission.  The  Fourier  transform  of 
Equation  (1)  Indicates  that  the  spatial  frequen¬ 
cy  content  of  Ie(x)  will  be  less  than  or  equal 
to  the  true  point  source  shadow  Image  I(x)  for 
all  spatial  frequency  components. 

F  {le(x>}  -  CF  jw(x)J  F  jl(x)j<  F  {l(x>}  (2) 

To  demonstrate  this,  consider  an  Incoherent 
line  source  of  dimension  l  and  a  source-to- 
object,  object-to-fllm  plane  ratio  d.  From 
Equation  (1),  the  resultant  Image  spatial  fre¬ 
quency  content  from  the  Fourier  transform 
operator  will  be 

f|i6(x)J  »  K^lS-iF  jl(x)J  (3) 

where  K  Is  a  constant  of  the  Imaging  geometry 
and  a  Is  2ird£f  where  f  Is  spatial  frequency. 

The  function  (Figure  3-a)  shows  zero  points 
at  some  spatial  frequencies  and  regions  of 
contrast  reversal  (regions  of  s1n(x)/x  that 
are  below  the  zero  axis). 


POINT  SOURCE  EXTENDED  SOURCE 


cat  ()l 


1  FIGURE  2.  PENUM*”'.  OR  VtOURPNCSS  OF  EXTENDED  SOURCE  SHADOW  IMAGES 

U)  SHOWS  THE  SHAPE  Of  THE  OENSITY  FUNCTION  PRODUCED  ON  FILM 
WHEN  A  POINT  SOURCE  IS  USED  AND  (HI  WHEN  AN  EXTENDED 
I  SOURCE  IS  USED 


FIGURE  3.  U>  INDICATES  THE  SPATIAL  FREQUENCY  DISTORTION  CAUSED  IY  AN  EXTENDED  SOURCE 
FOR  SHADOW  IMAGING 

(M  SHOWS  THE  AMPLITUDE  Of  THE  FILTER  FUNCTION  REQUIRED  TO  COUNTERACT  THIS 
DISTORTION 
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In  a  coherent  Imaging  system  (Figure  1),  we 
can  make  corrections  for  the  extended  source 
frequency  weighting  by  placing  the  proper 
filter  In  the  Fourier  transform  or  focal  plane. 
The  exact  correction  filter  may  not  be  physi¬ 
cally  realizable,  as  Is  the  case  for  the 
s1n(x)/x  frequency  distortion.  However,  we  can 
make  a  good  approximation  to  this  filter  and 
still  enhance  the  shadow  Images.  An  approxima¬ 
tion  to  the  Inverse  filter  for  s1n(x)/x  Is 
shown  In  Figure  3-b.  Figure  4  shows  the  actual 
photographic  filter  used  In  our  experiments. 

No  phase  shift  compensation  Is  Included  In  the 
filter  and  the  transmission  range  extends  over 
a  physically  realizable  range  of  zero  to  100% 
Instead  of  the  idealized  zero  to  Infinite 
transmission  range.  Figure  4  also  shows  two 
exposures  of  the  Fourier  transform  of  a  line- 
source  shadow  Image.  The  |x/s1n(x)|  filter 
was  designed  to  correct  for  this  line-source 
distortion.  Filter  regions  of  100%  trans¬ 
mission  correspond  to  the  severely  attenuated 
fi'equency  regions  of  the  object. 


FIGURE  4..  01 1 M  SHOW  IHt  AMU  INK  Of  THE  FOUUIEX  TRANSFORM 
Of  A1EST  PATTERN  IUIRRED  GY  SHADOW  IMAGING  WITH 
A  LINE  SOURCE.  Id  SHOWS  THE  AMPUTUOC  Of  THE  FIllER 
>  FUNCTION  USED  TO  OCIUIX  THE  TEST  PATTERN  IMAGE. 


The  filter  approximating  the  Idealized  line 
extended-source  correction  filter  produced 
Improved  Image  quality  (Figure  5-b).  Since 
the  filter  was  one-dimensional,  edge  sharpening 
appears  only  for  vertical  lines.  As  Indicated, 
the  greatest  edge  sharpening  and  contrast  en¬ 
hancement  occurred  at  the  higher  spatial  fre¬ 
quencies,  which  correspond  to  the  highly  atten¬ 
uated  frequencies  of  s1n(x)/x.  Note  that  a 
significant  sharpening  occurs  In  all  vertical 
lines. 
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FIGURE  5.  (a)  IS  A  PHOTOGRAPH  OF  THE  TEST  PATTERN  AS  IMAGED  BY 
AN  EXfENDED.LINE  SOURCE  '  ‘ 

lb)  SHOW  THIS  TEST  PATTERN  AFTER  SHARPENING  IN.THE 
OPTICAL  PROCESSOR  *  \ 
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Walsh  Filtering  of  Extended 
Source  Shadow  Image? 

The  Initial  problem  in  digital  enhancement 
of  shadow  Images  is  to  evaluate  the  Walsh  co¬ 
efficients  [5,6]  In  the  Walsh  series  representa 
tlon  of  x/sin(x).  These  coefficients  are  relat¬ 
ed  to  the  thickness  of  plates  containing  Walsh 
function  patterns  which  when  assembled  would 
provide  the  attenuation  proportional  to  x/sin(x) 
yielding  the  needed  optical  filter.  The  devel¬ 
opment  of  sin(x)/x  in  a  Walsh  series  offered 
no  difficulty.  The  results  are  Indicated  In 
Figure  6  where  Increasing  the  number  of  terms 
gives  a  closer  approximation.  However,  the 
function  is  discontinuous  beyond  the  range  of 
the  Walsh  function  definition,  o  <  x  <  1.  Con¬ 
sequently,  ax  replaced  x  In  the  development, 
a  being  used  to  obtain  the  needed  orders.  Even 
though  the  program  converged  rapidly.  Figure  7 
shows  that  greater  precision  Is  needed  for  large 
c(>20)  for  convergence  when  x  Is  near  1.  Figure 
7  also  shows  that  the  Inclusion  of  higher 
sequency  terms  yields  stability  for  greater 
values  of  x. 

The  evaluation  of  x/sin(x)  offered  serious 
problems  In  that  the  function  Is  not  square 
Integrable.  Anticipating  this  difficulty,  a 
series  expansion  was  developed  for  the  Integral 
of  x/s1n(x)  using  Cauchy  principle  values  when 
the  limits  spanned  poles  of  the  Integrand.  The 
subsequent  series  was  found  to  have  two  limit 
points.  Using  three  iterations  of  Cesaro 
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summability,  we  found  poor  convergence.  This 
difficulty  was  overcome  by  analytically  extract¬ 
ing  the  Cesaro  summable  part  and  substituting 
its  limit.  Additional  speed  In  summation  was 
had  by  extracting  another  summable  niece  and 
substituting  Its  limit.  The  remaining  series 
converged  Inversely  with  the  fourth  power 
of  the  summation  Index.  The  resulting  series 
representation  of  ax/sin(ax)  is  illustrated  In 
Figure  8  for  a  =  10.  Figure  9  shows  ax/sin(ax) 
for  a  =  20.  Note  that  the  type  of  Instability 
encountered  in  sin{20x)/2i)x  (Figure  7)  does 
not  occur. 
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FIGURE  &  WAISH  SERIES  EXPANSION  Of  10X/SINO0XI 
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FIGURE  9.  WAISH  SERIES  EXPANS  Iff)  OF  ^OXISINUOXI 


modulate  the  light  according  to  ax/sin(ax) 
which  wMl  mimic  the  process  used  in  optical 
filtering.  However,  the  construction  of  Walsh 
masks  is  costly  and  appropriate  for  only  one 
filter.  A  more  general  treatment  of  the  prob¬ 
lem  is  needed.  The  development  of  algorithms 
which  perform  the  counterpart  of  optical  filter¬ 
ing  within  the  computer  would  allow  flexibility 
in  the  construction  of  filters  for  a  wider 
class  of  image  enhancement  problems.  Although 
we  have  demonstrated  the  fitting  to  arbitrary 
precision  of  a  filter  function  with  Waish 
series,  the  limitations  of  this  technique  are 
unknown.  Further,  Walsh  transforms  of  con¬ 
voluted  images  may  not  yield  products  of  the 
transforms  of  the  images  as  does  Fourier  inte¬ 
grals  of  convoluted  images.  A  deeper  investi¬ 
gation  of  these  problems  is  essential  to  the 
successful  digital  computation  of  filter  func¬ 
tions  and  computerized  image  enhancement. 
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APPENDIX  * 

Analytical  development  of  Walsh  series 
Expansions 

A.  The  evaluation  ar  and  br  In  the  Walsh 
series  representation  of 


=2  arCal{r’x)  +  bSal(r.x)  (1). 


b.  3  f  Sal(s,x)dx,  s  *  0,1,2,. ..(Ill) 

s  ^  ax 

In  (111)  the  additional  orthogonality  condition 

,1 

/  Sal(r,x)Sal(s,x)dx  ■  6 
0  rs 

has  been  used. 

B.  The  evaluation  of  ar  and  br  in  the  Walsh 
series  representation  of 

oo 

5T7Sra  a^aUr.x)  +  brSal(r,x)  (iv) 

where  0  5  x  <1,  a  >  0. 

The  same  steps  used  in  A  yielded: 

r ' 

8s  =,'0  ?1tox  Cal(s,x)dx*  s  *  M 

bs  ISTOx  Sal<s,x)dx,  s  =  0,1,2,...  (vl) 

C.  The  partition  of  integrals  of  Walsh 
function. 

The  integrals  to  be  evaluated  in  (11), 
(Hi)*  (v),  and  (vi)  are  of  the  form 


where  0  <  x  <1 ,  a  >  0. 

Taking  tne  product  of  (1)  with  Cal(s,x) 
and  Integrating  over  x, 

as  *  •[  ^ooF  Cal(s,x)dx,  s  =  0,1,2,...  (il) 

In  (11),  use  has  been  made  of  the  orthog¬ 
onality  conditions  for  Walsh  functions: 

rl 

J  Cal(r,x)Cal(s,x)dx  ■  6^ 

,1 

J  Sal(r,x)Cal(s,x)dx  =  0 


where  the  (xk(s)}  are  the  x's  for  which  the 
Walsh  function  are  discontinuous.  This  set  of 
x's  is  evaluated  from  the  given  sequency  s  in  a 
sequence  of  arithmetic  operations.  The  number 
of  values  (+1  or  -1)  the  given  function  takes 
for  0  5  x  <1  is  evaluated. 


p’s  +  1  for  Cal(s,x)' 
1 2s  for  Sal(s,x) 


(vl i i ) 


The  Walsh  function  index  is  evaluated  from  k  by 
the  following: 


I  Let  k2  =  k  -1 ; 


II  Let  k2 


C^2 


where  C^e 


Ill  The  Walsh  function  Index  Is  N  where 


N  =  k2  X  jk2/2]  =  V  C^1  ?  ^  C^1"1 

1=0  M=0 


00 


1 


In  III,  di 


o  if  ci  =  c1+1 

I  otherwise 


this  defines 


dyadic  addition  (+).  The  non-zero  d.  In  the 
evaluation  of  N  have  Indices  i  which1 denote  the 
Rademacher  functions  which  are  factors  of  the 
Walsh  function  WN(x)  which  corresponds  to  the 
given  function  having  k  constant  values.  The 
value  of  each  factor  Rademacher  function  Is 
found  with  the  following  algorithm: 


Given  the  set  of  I's  for  which  d^  f  0, 

IV  Let  H  =  [2^+1x]  where  [  ]  denotes  the 
largest  Integer  contained  in. 

fM  Is  even  R.,(x)  =  ll 

Hf  1  \ 

{»  Is  odd  R^x)  =  -lJ. 

The  value  of  WN(x)  is  found  from  the  product  of 
the  values  of  the  R^x)  for  which  di  0. 

However,  we  seek  the  set  of  x's  at  which  Kn(x) 
Is  discontinuous.  These  are  evaluated  by 
determining  the  maximum  nuiriber  of  Internals 
from  the  di  f  0. 


f 

xj 

«s 


j+1 

g(x)dx  =  -  G(xj),  (vll)  becomes: 


{G^xj+1^  ’  V°  and  XN+1  ' 
j-0 


-  -G(0)  +2 


(-i)J+1G(  Xj)  +  (-l)*fe(i)(ix) 


The  function  In  (i)  and  (ill)  is  the  Sin 
integral.  The  values  of  G(x)  are  evaluated 
through  the  use  of  an  infinite  series  expansion 
of  Sln(ax).  Here, 


6(v)  =/V^JsIdx  =  l 

J  ax  a 


y(_,  )k  (ax)2^1 
k^O  (2k+l)(2k+l)l 


(x 


The  function  in  (v)  and  (vi)  is  not  defined. 
The  values  of  G(x)  are  determined  through  the 
following  procedure: 

Here  G(v)  =  /  dx  a  dZ  (xi ! 

We  can  obtain  a  Mittag-Leffler  expansion  of 
the  integrand  in  terms  of  its  simple  Isolated 
poles. 


VI  Let  M  «  max(ied.),  then  WN(x)  contains  no 
more  than  2M+‘  values. 


These  are 
let 


fx  1 
xMjj 

-1 

fj/2M+1 

x.. 

■Jj 

►  b  A 

j/21+1 

the  d^ 

},  j  -  0,1,2 . 2 

■,  '•  ■<  1  taken  from 
Is  0, 

i+1 


H+l 


i  =  0,1,2,...,  2 

Ignoring  the  first  entry  In  each  set,  the 
surviving  set  of  x^'s  are  those  elements  of 

M‘  '  °)  which  .ra/e  an  odd  number  of 


occurrences  for-  fixed  1. 


D.  Evaluation  of  the  Integrals. 

The  evaluation  of  as  or  b-  proceeds  with 
the  evaluation  of  the  Integrals  in  (1i),  (ill), 
(v) ,  and  (vi).  The  appropriate  coefficient  may 
be  chosen  for  and  the  appropriate  function 
for  g(x)  in  (vii).  Denoting 


where  Ct  =  lim  (Z-kn) 2/S1n7  =  (-1  )kKir. 
*  Z-*krt 


Suppose  we  seek  a  definite  integral  of  (xii) 
over  an  interval  containing  a  pole: 

a  f  Z  5  u,  a  <  J.  i  <  u 


k=-« 


lakina  out  the  second  sum 


♦  h.  +ru  *f\. 

e-K)  Va  **"  J^rnl 

=  ^(-1)kknjln(u-kiT)  -  ln(a-kir)| 

k=-oo 

+  ^(-l)kkrr|ln{kir-u)  -  ln(kn-a)j 
k=£+l 

+  11m  (-1  —-{-ft  ~  eA 

e- 0  \  lr  ■  a  } 

(  u  -  U  \1 

l  tn  +  e  Jt'u  J  J 

=  V(-l)kkTrln|u  -  ku|-  V{-l)kkirln|a-k»r| 
k?*0  Fo 


Since  I  has  the  form  G{u}  -  G(a),  wa  may  choose 
to  evaluate  (xl)  as  follows: 


+  11m  (-irtWlnpg-^— ~  £)  1 
t-*Q  \  \  lr  -  a  J 


(xiil) 


S(v)  =  -\'(-1)kkTiln|av  -  kn | 


Equation  (xlli)  may  be  put  In  the  form 


00 

G(v)  «=  £  Y(-l)kk  )nj(l  -  ov/kr)/{l  +  av/kn) | 


In  (xlv)  convergence  Is  still  slow.  Using  the 
series  expansion 


Inj (1  -  x)/(l  +  x) |  =  -2  V  x'-lc-l/(2k-l) 

Fl 

for  [  x  |  ■:  1  as  a  model,  we  may  add  and  sub¬ 
tract  the  term  2a\ykr  within  the  summation. 

G(v)  -  l  ^t-f)k  k|ln:{l-ov/k»)/0  +  <xv/k*)| 
+  2av/kir  -  2av/k«j 


G(v)  -  -1  V(-l)k.k(2o(v/k1r)  +  £  y(-l)k 

Fl  Fl 

•kujln|(l-av/kit)/(l  +  ew/kir)|  +  2ao/kir|| 


V,  .vk+1  n  it  ^  i|k 
=  av>  (-1)  “  -  >(-l) 

Fl  FI 

•kjln|(l  -  av/k»)/(l  +  av/kTt)|  +  2ow/kir|. 

The  first  series  has  partial  sum 
{1,0, 1,0,1,...}.  The  nth  Cesaro  sum 

Gn  =>  (n/2)/n  1/2  as  n  <*■.  Replacing  the  sum 

by  Its  Cesaro  limit,  G(v)  >-  v 


a  ^(‘1)k  41 

Fl  »■ 
2c,o/kffj. 


1n|(l  -  ctv/kw)/(l  +  ctv/kx) | 


+  2o,o/kir|.  (xv) 

However,  (xv)  still  converges  like  1/k*  for 
large  k  an-J  is  too  slow  for  our  purpose.  Me 
may  extract  another  term  by  the  above  method. 
This  term  is  2  (av/k»)3/3. 

G(v)  -u+i^(-l)k 

•k|lnj(l  -  av/k»)/(l  +  cw/kir)  | 

♦  2av/kir  +  2(av/kn)3/3  -  2(ctv/k7t)3/3|. 

C.J  . 

.  -2.  V {-IT  k2(cw/ku)3/3  +  v 

t-1 

+  £  7(-l)k  k(ln|(l  -  a»/kir)/(l 
Fl  '■ 

+  av/ku)  |+  2av/kn  +  2(<r..,/k'n)--'/3|. 

The  Initial  sum  .'educes  to 

I-  SLii  f{-l)M/k2  -  «2v3/18.  Hencs 


G(v)  «  v  +  cV/18  +  £ 
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A  WIRED-IN  RESISTOR  CIRCUIT  REALIZATION  OF  THE  TWO-DIMENSIONAL 
KADAMARD- TRANSFORMAT  I  ON  OF  BROADBAND  TELEVISION  SIGNALS 

UWE  KRAUS 

INSTITUT  FOR  TECHNISCHE  ELEKTRONIK  DER  RWTH  AACHEN,  GERMANY 


Introduction 


In  recent  years  the  transmission  of 
broadband  TV-signals  by  PCM-system  could 
be  realized.  In  PCM-technique  signal  re¬ 
generation  without  decrease  of  the  S/N- 
ratio  can  easily  be  done.  The  disadvan¬ 
tage  is  the  great  demand  for  frequency 
band-width. 

Therefore,  in  many  papers  (1)  sugges¬ 
tions  have  been  discussed  to  reduce 
TV-signal  band-width.  All  these  tech¬ 
niques  try  to  decrease  the  bit-rate  by 
redundancy  reduction  and  a  suitable  re¬ 
duction  of  irrelevant  information. 

The  transformation  method  is  one  of 
these  techniques.  An  orthogonal  trans¬ 
formation  is  applied  to  the  sampled  pic¬ 
ture  elements.  The  coefficients  «re  de- 
correlated  and  represent  the  redundancy 
reduced  picture  information.  A  reduction 
of  irrelevant  information  is  possible  by 
spatial  filtering.  This  can  be  done  by 
suppression  of  some  coefficients  and 
quantization  of  the  other.  The  picture 
is  reconstructed  by  transforming  back 
into  the  original  domain. 

The  transformation  by  means  of  the  Ha- 
damard  matrix  can  easily  be  performed 
because  the  elements  of  the  matrix  have 
only  the  values  +1  and  -1.  The  results 
of  computer  simulations  have  shown  that 
a  high  data  compression  can  be  achieved 
especially  by  the  use  of  the  two-dimen¬ 
sional  Hadamard  transformation. 

The  matrix  multiplication  of  the  Hada¬ 
mard  transformation  can  be  performed  on 
a  digital  computer  as  well  as  by  means 
of  an  analogous  technique  using  resis¬ 
tor  and  amplifier  networks.  This  will 
now  be  discussed  with  respect  to  real 
time  operation  of  moving  pictures  in  fu¬ 
ture. 

At  first,  an  experimental  set  is  descri¬ 
bed  that  transforms  TV-pictures  scanned 
in  CCIR-standard  in  sub-frames  into  the 
two-dimensional  Hadamard  domain  and  back 
again.  After  this  some  considerations  of 
possibilities  of  realization  of  real  ti¬ 
me  operation  are  made. 


Experimental  set  for  performing  the  two 
dimensional  Hadamard  Transformation  in 
sub-frames 


Size  of  the  sub-frames 

The  size  of  the  adjacent  sub-frames  was 
fixed,  so  that  on  an  average  for  a  lot 
of  TV-pictures  only  a  few  correlation 
should  exist  between  picture  elements 
lying  on  opposite  edges. 


D:  Deiay-line,T.=0,1;js,M:  Multiplier, 
1:  Integrator,  RC=  Is,  V.  Voltmeter 


Fig.  t  Block  diagram  of  auto-correlator 


By  means  of  the  experimental  set  shown 
in  Fig.  1  the  autocorrelation  functions 
of  a  lot  of  diapositives  scanned  in  CCIR 
standard  are  measured.  The  set  performs 
the  function 

r 


4>xJt) :  lim 

1— 


-L  ftm-m-T)  <tt 
'2TcT 


1 1 ) 


The  delay-line  is  adjustable  to  steps  of 
0,1  ps.  The  Integration  is  carried  out 
with  a  time-constant  of  1  s,  so  the  aver 
age  value  of  many  TV-frames  is  achieved. 


Some  of  the  measured  functions  are  shown 


in  Fig.  2. 


Fig.  2  Measured  outo-correlation  functions  of 
TV-signals 
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One  can  see  that  the  rather  different 
looking  curves  still  have  a  relative  big 
value  at  x  *  0,5  us.  Therefore  a  sub- 
frame  size  o J  8x8  picture  elements  was 
provided.  8ut  because  of  costs  a  sub- 
frame  size  of  4x4  picture  elements  was 
realized. 


Principle  of  operation  of  the  exoerimen 
taT'set -  - - 

Scanning  scheme 


Fig.  4  shows  the  block  diagram  of  the 
whole  set.  An  amplifier  feeds  the  ana¬ 
logous  video  signal  of  the  picture  source 
(e.g.  a  flying  spot  scanner)  simultane¬ 
ously  in  the  Inputs  of  16  sample  and 
hold  circuits.  The  logic  circuit  I  de¬ 
rives  16  sequential  triggerpulses  from 
the  12  MHz  master  clock  and  the  synchro¬ 
nizing  pulses  H  and  V.  The  trigger  pul¬ 
ses  open  the  sample  and  hold  circuits 
for  a  time  of  0,08  us  using  the  scheme 
shown  in  Fig.  3. 


To  perform  the  transformation  It  is  ne¬ 
cessary  that  the  samples  of  the  sub- 
frame  to  be  transformed  are  all  present 
at  the  same  time.  As  the  picture  ele¬ 
ments  are  scanned  sequentially  line  by 
line,  the  elements  belonging  to  one  sub 
frame  are  stored  in  sample  and  hold 
circuits. 


-0—1 
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-1- 

-m-i 

k-l- 

-• — • — • — ^ 

_ 

So 

b-fram 

Fig.  3 
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rame  into 
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Fig.  3  shows  the  partition  of  the  TV- 
frame  into  sub-frames.  During  the  first 
TV-line  the  picture  elements  a,  b,  c,  d 
of  the  sub-frame  Fj  (x.y)  are  stored 
each  In  one  sample  and  hold  circuit.  Du¬ 
ring  the  next  TV-line  -  this  is  the 
third  because  of  interlace  system  -  the 
picture  elements  i,  j,  k,  .1  are  stored. 
The  elements  of  the  second  and  fourth 
line  must  be  stored  on  succession  of  the 
next  frame.  After  having  transformed  the 
stored  picture  elements  the  elements  of 
sub-frame  Fj  (x.y)  are  stored  and  so  on. 


A  matrix  circuit  HM  transforms  the  sto¬ 
red  signals  Into  the  Hadamard  domain.  A 
second  circuit  of  the  same  kind  performs 
the  transformation  back  into  the  origi¬ 
nal  domain.  Short  samples  of  0,08  us  du¬ 
ration  are  taken  sequentially  from  the 
retransformed  signals  by  means  of  an  ana¬ 
logue  multiplexer  and  led  to  a  TV-moni- 
tor  which  is  also  synchronized  by  the 
pulses  H  and  V. 

The  logic  circuit  II  controls  the  multi¬ 
plexer  in  a  way  that  the  retransformed 
picture  elements  are  written  on  the  mo¬ 
nitor  screen  In  the  same  succession  as 
the  original  elements.  The  reproduced 
sub-frame  appears  on  the  screen  In  the 
original  position.  The  rest  of  the  screen 
is  dark. 

Storing  and  reproducing  of  one  sub-frame 
takes  a  time  of  four  TV-frames.  All  sub- 
frames  are  processed  in  half  an  hour.  As 
the  monitor  screen  is  photographed  du¬ 
ring  this  time  the  complete  reconstruc¬ 
ted  picture  is  stored  on  the  film. 

The  spatial  filtering  can  be  done  be¬ 
tween  the  matrix  circuits  by  supresslon, 
thresholding  end  quantization. 


Realization  of  the  matrix  circuit 

To  perform  the  transformation  of  the  sub¬ 
frame  into  the  two  dimensional  Hadamard 
domain  the  matrix  circuit  has  to  realize 
equation  (2). 

[A  ( k.m)]  s  [H  ( k.m)]{F  I x, y  |]{h  ( k.m  )]  (  2  ) 


The  whole  TV-pIcture  is  subdivided  into 
168  sub-frames  in  horizontal  and  145  In 
vertical  direction. 


Block  diagram  of  the  set 


A*  4  etc grtm  0  mffh nkil  tW 


with 

A(k,m):  matrix  of  coefficients 
HI  k.m):  Hadamard  matrix 
FI  x.y  ) :  matrix  of  picture  elements  of 
a  sub-frame 

in  detail 
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The  transformation  is  performed  in  two 
steps. 

At  first  the  elements  of  the  matrix  Isiu.vfl 
are  defined. 
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The  transformation  circuit  shown  In  Fig. 
5  works  with  the  principle  of  current 
addition.  The  signal  voltages  e.g.  re¬ 
presenting  the  picture  elements  a,  b,  c, 
d  of  the  first  row  of  the  sub-frame  con¬ 
trol  the  current  sources  consisting  of 
the  transistors  Tl,  T3,  T5,  T7  and  their 
emitter  resistors  R.  The  collector  cur¬ 
rents  are  added  In  another  transistor 
T9  the  collector  voltage  of  which  repre¬ 
sents  the  coefficient  Soo  with  negative 
sign.  The  circuit  Is  completed  by  the 
transistors  T2,  T4,  T6,  T8,  T10,  and 
Til.  The  transistor  pairs  Tl  T2,  T3  T4, 
T5  T6,  and  T7  T8  represent  differential 
amplifiers  fed  by  the  common  constant 
current  source  Til.  The  collector  vol¬ 
tage  of  T10  represents  the  coefficient 
•i  Soo. 


Further  considerations  have  led  to  con¬ 
ceptions  of  transmission  of  moving  TV-  * 
pictures  In  the  two-dimensional  Hadamard 
domain.  But  using  the  usual  line  by  line 
scanning  scheme  the  samples  of  a  sub-fra 
me  can  be  present  at  the  same  time  not 
before  the  second  TV-frame, as  shown. 


operation 


A  signal  voltage  fed  Into  the  base  of  an 
even  numbered  transistor  of  a  differen¬ 
tial  amplifier  with  the  base  of  the  odd 
numbered  transistor  Is  grounded  makes  a 
negative  contribution  to  the  sum.  In 
this  way  the  signal  voltages  can  be  va¬ 
lued  according  to  the  sign  of  Hadamard 
matrix  elements. 

In  the  second  step  of  transformation 
the  equation  (5) 

[A(k.m)]  r  [Hlk.m)][s(u.vl]  ( 5  ) 

Is  carried  out  by  the  right  part  of  the 
circuit  diagram  shown  In  Fig.  5.  The 
transistors  T12  to  T27  and  their  emitter 
resistors  are  current  sources  controlled 
by  the  coefficient  voltages  +Sov  or  -Sov 
according  to  the  Hadamard  coefficients. 
Changes  of  signal  polarity  In  the  tran¬ 
sistors  T28  to  T31  must  be  taken  Into 
consideration.  The  collector  voltages 
of  these  transistors  represent  the  co¬ 
efficients  Aom. 

The  whole  transformation  circuit  Is 
built  on  four  printed  cards  each  of 
which  produces  four  column  coefficients 
of  the  matrix  [A  (k.mj  .  As  the  trans¬ 
formation  circuit  consists  of  semicon¬ 
ductors  and  resistors  only  an  integra¬ 
ted  technique  realization  seems  to  be 
possible. 

Another  four  cards  built  and  wired  as 
described  transform  the  coefficients 
back  Into  the  original  domain.  Equation 
(6)  is  realized. 

[Flx.yl]  :  -ijfHlk.mljjAlk.mlllHtk.ml]  (6) 
with  N:  order  of  matrix 

The  gains  of  tbs  matrix  circuits  are 
adjusted  so  t.iat  the  reconstructed  sig¬ 
nals  have  the  same  value  of  voltage 
like  the  Input  signals. 


This  difficulty  can  be  avoided  by  em¬ 
ploying  the  modified  scanning  scheme  of 
Fig.  6.  Each  sub-frame  Is  scanned  column 
by  column.  All  sub-frames  can  be  scanned 
within  the  time  of'- 40  ms  using  the  usual 
electron  beam  velocity. 

Fig.  7  Illustrates  the  block  diagram  of 
a  transform  apparatus  working  1r.  real 
time.  The  picture  source  e.g-  running  an 
electrostatically  deflected  ’dlcon  uses 
the  scanning  scheme  shown  1'  ig.  6.  The 
transformation  circuit  consists  of  two 
Identical  parts  I  and  II  working  in  pa¬ 
rallel.  Each  part  possesses  an  array  of 
16  sample  and  hold  circuits,  a  transfor¬ 
mation  circuit  shown  In  Fig.  5,  and  a 
parallel-serial-converter.  A  synchron 
pulse  generator  controls  the  set  in  or¬ 
der  that  e.g.  the  sub-frames  Fi  (x,y), 

F3  (x.y)  -  F2n-i  (*»y)  *r*  processed 

in  the  circuit  part  I  and  the  sub-frames 

f2  (x,y),  Ft  (x.y) .  F2n  (x.y)  In 

part  II. 

port  I  :  store  Fj^x.y)  transmit  Ajn_,tk,m) 

partll  :transm.  A^k.m)  store  F*„  (x.y) 

position 

ofswitchS:  II  1 

The  coefficients  are  transmitted  in  PCM- 
system. 

Sub-frame  transformation  in  real-time 
can  be  carried  out  In  digital  technique 
too  (Fig.  8).  The  picture  source  also 
works  with  the  scanning  scheme  of  Fig. 6. 
First  of  all  the  analogous  video  signal 
Is  converted  to  straight  PCH.  The  trans¬ 
formation  circuit  consists  of  two  iden¬ 
tical  parts  I  and  II  again.  A  demulti¬ 
plexer  loads  the  code  words  of  the  first 
sub-frame  column 'to  four  adders  1  to  4 
operating  in  parallel,  the  data  of  the 


second  column  to  the  adders  5  to  8  etc. 
The  adders  are  programmed  in  order  that 
successive  code  words  are  added  or  sub¬ 
tracted  according  to  the  Hadamard  ma¬ 
trix. 

The  adders  1  to  16  r.erform  the  f1»st 
step,  the  one-dimensional  transformation. 
The  adders  17  to  32  constructed  and  pro¬ 
grammed  in  the  same  way  compute  the  two- 
dimensional  Hadnmard  coefficients.  Rea¬ 
lization  in  TTL-technique  seems  to  be 
possible  because  in  worst  case  an  adder 
must  add  a  new  code  word  every  0,1  ps. 

Controlled  by  the  synchron  pulse  gene¬ 
rator  the  circuit  parts  I  and  II  work 
together  in  the  same  way  as  shown  in 
Fig.  7. 

A  real-time  transmission  of  CCIR-stan- 
dard  scanned  pictures  in  the  two-dimen¬ 
sional  Hadamard  domain  is  possible  If 
the  picture  elements  of  four  TV-lines 
are  written  into  a  store  and  red  out 
in  such  a  sequence  that  picture  elements 
belonging  to  a  sub-frame  appear  succes¬ 
sively  at  the  store  output. 

Such  a  store  can  be  realized  by  means 
of  random  access  read/write  memories. 

At  first  the  video  signal  is  analogue/ 
digital  converted.  The  code  words  of 
four  TV-lines  are  stored  with  a  definite 
succession  of  addresses.  They  are  red 
out  with  a  different  succession  of  ad¬ 
dresses  so  that  the  code  words  of  a 
sub-frame  appear  successively.  They  can 
be  processed  in  a  digital  transformation 
circuit  as  shown  in  Fig.  8.  During  the 
read  out  the  picture  elements  of  the 
next  four  TV-lines  ere  stored  In  a  se¬ 
cond  digital  store. 

Another  realization  of  such  a  scanning 
scheme  converter  is  possible.  Consider 
a  long  digital  shift  register  that  sto¬ 
res  all  code  words  of  four  TV-lines. 

This  shift  register  consists  of  sub  re¬ 
gisters  in  series  arrangement  with  the 
capacity  to  store  the  bits  of  one  sub- 
frame  row.  After  the  data  of  four  TV- 
lines  have  been  red  in,  the  shift  re¬ 
gister  is  reorganized  by  gates  in  order 
that  a  new  long  shift  register  Is  formed 
with  the  sub-registers  of  the  sub-frames 
in  series  arrangement,  f. jading  out  the 
new  shift  register  the  code  words  leave 
in  the  wanted  succession. 


Conclusion 

An  experimental  set  was  described  that 
transforms  TV-pictures  into  the  two-di¬ 
mensional  Hadamard  domain  and  vice  ver¬ 
sa.  Compression  ratio  and  picture  qua¬ 
lity  are  similar  to  the  results  of  com¬ 
puter  simulations.  Further  more  Is  was 
shown  that  real-time  transmission  of 
TV-signals  in  the  two-dimensional  Hada¬ 
mard  domain  is  possible  by  means  of  ana¬ 
logous  as  well  as  digital  circuits.  A 
modified  canning  scheme  and  CCIR  stan¬ 
dard  can  be  used.  Some  problems  e.g. 
dealing  with  interlace  still  must  be 
solved.  Further  technical  and  financial 
considerations  must  decide  what  sort  of 
system  will  bo  realized. 
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Introduction 

In  1968  the  concept  of  coding  and  trans- 
.mitting  the  two  dimensional  Fourier  transform 
of  an  image,  computed  by  a  fast  computational 
algorithm,  rather  than  the  image  itself,  was 
introduced  [l,2].  This  was  followed  shortly 
thereafter  by  the  discovery  that  the  Walsh- 
Hadamard  transform  could  be  utilized  in  place 
of  the  Fourier  transform  with  a  considerable 
decrease  in  computational  requirements  [3  j  . 
Investigations  then  began  into  the  application  of 
the  Karhunen-Loeve  [4]  and  the  Haar  [5]  trans¬ 
forms  for  image  coding.  The  Karhunen-Loeve 
transform  provides  minimum  mean  square  er¬ 
ror  coding  performance  but  does  not  possess  a 
fast  computational  algorithm.  On  the  other 
hand  the  Haar  transform  has  the  attribute  of  an 
extremely  efficient  computational  algorithm, 
but  results  in  a  relatively  Urge  coding  error. 
None  of  the  transforms  mentioned  above,  how¬ 
ever,  has  been  expressly  tailored  to  the  char¬ 
acteristics  of  an  image. 

A  desirable  property  for  an  image  coding 
transform  is  that  the  transform  compact  the 
imago  energy  to  as  few  of  the  transform  do¬ 
main  samples  as  possible.  Qualitatively  speak¬ 
ing,  a  high  degree  of  energy  compaction  will 
result  if  the  basis  vectors  of  the  transform¬ 
ation  matrix  "resemble"  typical  horizontal  or 
vertical  lines  of  an  image.  If  one  examines  the 
lines  of  a  typical  monochrome  image,  it  is 
found  that  a  Urge  number  of  the  lines  are  of 
nearly  constant  grey  level  over  a  considerable 
length.  The  Fourier,  Hadamard,  and  Haar 
transforms  possess  a  constant  valued  basic 
vector  that  provides  an  ufflcient  representation 
for  constant  grey  Wei  image  lines,  while  the 
Karhunen-Loeve  transform  has  a  nearly  cons¬ 
tant  basis  vector  suitable  for  this  representa¬ 
tion.  Another  type  of  typical  image  Une  is  the 
line  that  linearly  increases  or  decreases  in 
brightness  over  the  length.  None  of  the  daU 
transforms  previously  mentioned  possess  a 
basis  vector  that  efficiently  represents  such 
image  lines. 


Shibata  and  Enomoto  have  introduced 
orthogonal  transformations  containing  a 
"sUnt"  basis  vector  for  data  of  vector  lengths 
of  four  and  eight  [6].  The  slant  vector  is  a 
discrete  sawtooth  waveform  decreasing  in 
uniform  steps  over  its  length,  and  is  suitable 
for  efficiently  representing  gradual  brightness 
changes  in  an  image  line.  Their  work  gives 
no  indication  of  a  construction  for  Urger  t 
daU  vectors,  nor  exhibits  the  use  of  a  fa t  . 
computational  algorithm.  In  order  to  achieve 
a  high  degree  of  image  coding  compression 
with  transform  coding  techniques,  it  is 
necessary  to  perform  the  transformation  in 
two  dimensions  over  block  sizes  of  16  x  16 
picture  elements  or  greater  [?}.  For  Urge 
block  sizes,  computation  is  usually  not  feas¬ 
ible  unless  a  fast  algorithm  is  employed. 

With  this  background  an  investigation  was 
undertaken  to  develop  an  image  coding  slant 
transform  matrix  possessing  the  following 
properties: 

1.  orthogonal  set  of  basis  vectors. 

2.  consUnt  basis  vector. 

3.  slant  basis  vectors. 

4.  sequency  property. 

5.  varUble  size  transformation. 

6.  fast  computational  algorithm. 

7.  high  energy  compaction. 

The  following  sections  describe  the  construe  - 
tion  of  the  slant  transformation,  matrix,  pre¬ 
sent  a  fast  computational  algorithm  for  its 
computation,  discuns  its  image  coding  per¬ 
formance,  and  provide  examples  of  its  use 
for  coding  monochrome  and  color  images. 

SUnt  Transform  Construction 

For  a  vector  length  of  N  =  2  the  sUnt 
transform  is  identical  to  the  Hadamard  trans¬ 
form  of  order  2.  Thus, 

[Szl  ’  3*  [,  .,] 
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The  slant  transform  matrix  for  N  =  4  can  be 
written  as 


where  a  and  b  are  real  constants  to  be  deter¬ 
mined  subject  to  the  conditions  that  S4  must  be 
orthogonal  and  that  the  step  sire  of  the  slant 
basis  vector  must  be  the  sa—e  throughout  its 
length.  The  step  size  between  the  first  two 
elements  of  the  slant  vector  is 


(a+b)  -  (a-b)  =  2b  (3) 

and  the  step  size  between  the  second  and  third 
elements  is 

(a-b)  -  (-a+b)  =  2a  -  2b  (4) 


Hence, 


a  =  2b 


The  slant  matrix  of  order  four  may  then  be 
reformed  as 


By  the  orthogonality  condition 

[3b  b  -b  -3b]  [3b  b  •  b  3b]T  =  1 

it  is  found  that 


It  is  easily  shown  that  S4  is  orthonormal. 
Further  note  that  S4  possesses  the  sequency 
property;  each  row  has  an  increasing  number 
of  sign  reversals  from  0  to  3.  The  fast  comp¬ 
utational  property  of  is  apparent  from  the 
matrix  decomposition 


If  S4  i*i  post  multiplied  by  a  column  data  vector, 
the  first  computational  pass  requires  4  addi¬ 
tions,  the  second  pass  requires  2  multiplica¬ 
tions  (the  two  elements  1/3)  and  the  final  pass 
requires  4  multiplications  including  the  norm¬ 
alizing  factor  of  1/Jf.  The  total  computational 
requirements  are  8  adds  and  6  multiples.  For 
purposes  of  comparison  a  fourth  order  Hada- 
mard  transform  requires  8  adds  and  4  multi¬ 
ples.  Figure  1  contains  a  flow  chart  of  the 
computational  operations  for  S4. 


Figure  1.  Slant  transform  of  order  4-compu- 
—  tational  flowchart. 


An  extension  of  the  slant  matrix  to  its  next 
size  increment  Sg  is  given  by 


where  ag  and  bg  are  constants  to  be  determin¬ 
ed  to  satisfy  the  slant  and  sequency  properties. 
In  Sg  the  slant  vector  is  obtained  by  a  simple 
scaling  operation  ou  S4.  The  remaining  terms 
in  eq.  (8)  are  introduced  to  obtain  the  sequen¬ 
cy  and  orthogonality  properties. 

Equation  (8)  can  be  generalized  to  give 
the  slant  matrix  of  order  N  in  terms  of  the 


slant  matrix  of  order  N/2  by  the  following  con¬ 
struction. 


that  many  of  the  mid-sequency  basis  vectors 
are  identical  for  the  two  transforms. 


where  I  represents  a  2  x  2  identity  matrix.  To 
determine  the  coefficients  (afj«  bjvj)»  one  pro¬ 
ceeds  as  follows:  The  first  row  is  a  constant 

V1'1'  '  it 

The  second  row  (the  slant  vector)  is  a  linear 
function  of  the  column  index  which  is  ortho¬ 
gonal  to  the  first  row.  It  must  therefore  be  of 
the  form 

SN(2.i)  =  xN(N+l-2i) 

Now,  by  the  recursion  indicated  in  eq.  (9),  for 
i  s  N 

S2N«2'l|"^*2NV1’l|*irb2NV2’‘> 


*2N,2Nt1-21'  ‘  7m  “2N  *  b2K  J  lN*‘-2» 

From  this  one  obtains 

_  .  XN 
X2N  "  2N  7? 

*-..3/2 

a2N^N  X2N 

and  by  induction 

a2N  =  Zb2NaN 

Since  Sn(1,  • )  and  S^(2,  • )  are  orthogonal  unit 
vectors  in  N  dimensions  and  S2t\j{2,  • )  is  a  unit 
vector  in  2N  dimensions,  the  above  recursion 
implies 

■«l|S2N<2.-)ll=.2N.b2N 

These  two  relations  can  be  used  to  obtain  the 
coefficients,  (a^»  bfj)  recursively: 

al  =  1 

b2N  ■ 

a2N  =  2b2NaN 

Figure  2  contains  a  superimposed  plot  of 
the  Walsh-Kadamard  and  Slant  basis  vectors 
for  a  vector  length  of  sixteen  for  the  con¬ 
struction  of  eq.  (9).  It  is  interesting  to  note 


-■  ‘-lj  try  o=r’ 
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Figure  2.  Comparison  of  Walsh-Hadamard 
and  Slant  basis  vectors  of  length 
16. 


Slant  Transform  Propertieg 

Let  [f")  be  a  column  data  vector  and  [f] 
its  slant  transform  obtained  by  the  operation 

[F]  =  [SN][f]  (10) 

Consider  [f]  to  be  a  sample  of  a  vector  ran¬ 
dom  process  with  known  mean  [f *)  and  with  a 
known  covariance  matrix 

[c£i  =  (tf]  -  [fixCf]*  -  cm  (ii) 

where  the  overbar  indicates  a  statistical  aver¬ 
age.  The  covariance  matrix  of  the  Slant  trans¬ 
form  [F"l  is  found  to  be  [8] 

[CF1  =  [SNl[Cf1[SNlT  (12) 

Equation  (12)  can  be  considered  a  two  dimen¬ 
sional  Slant  transformation  of  the  data  covar¬ 
iance  matrix  for  purposes  of  computation. 
Figure  3  contains  a  perspective  view  of  the 


Figure  3.  Perspective  view  of  Slant  trans¬ 
form  covariance  matrix- Markov 
process  data  vector,  p  =  C.  95, 

N  =  256. 

Slant  transform  of  a  data  vector  of  length  N  = 
256  with  a  Markov  process  covariance  of  the 
form 

[cf]=  P|xi-xj> 

where  p  is  the  correlation  of  adjacent  ele¬ 
ments  [f],  Figure  4  is  a  plot  of  the  variance 
of  the  Slant  transform  samples  as  a  function 
of  sequency.  The  variance  functions  for  the 
Walsh- Hadamard,  Fourier,  Haar,  and  Kar- 
hunen-Loeve  transforms  are  included  for 
comparison.  It  is  seen  that  the  variance  func¬ 
tion  for  the  Slant  transform  is  reasonably 
close  to  the  variance  function  of  the  Karhunen- 
Loeve  transform,  which  is  known  to  provide 


the  best  energy  compaction  for  the  Markov 
source. 


TRANSFORM  DOMAIN  VARIABLE, /x 
Figure  4.  Transform  domain  variance,  vector 
length  =  16,  element  correlation  = 
0.95. 

Slant  Transform  Image  Coding 

Let  [f(x,  y)1  represent  the  brightness 
samples  of  an  N  by  N  element  image.  The  two 
dimensional  Slant  transform  of  the  image  is 
given  by 

[F(u,v)]  =  [SN1[f(x,y)][SN1X 

In  effect,  the  pre-multiplication  of  [f(x, y)]  by 
[Sjsj"|  performs  a  one  dimensional  slant  trans¬ 
form  of  each  column  of  the  image  matrix,  and 
the  post-multiplication  by  [Sjv]l  performs  a 
one  dimensional  transform  of  the  rows  of  the 
image.  Figure  5  contains  a  photograph  of  a 
256  by  256  element  image  with  64  grey  levels 
and  its  two  dimensional  Slant  transform. 

A  bandwidth  reduction  can  be  obtained 
with  the  Slant  transform  by  efficiently  quantiz¬ 
ing  each  transform  domain  sample.  There 
are  two  basic  strategies  for  the  quantization 
process  -  zonal  and  threshold  quantization. 

In  the  former,  various  zones  are  established 
in  the  transform  domain,  and  each  sample  in 
the  zone  is  coded  with  the  same  number  of 
bits  set  proportional  to  the  expected  variance 
of  the  samples  within  the  zone.  With  thres¬ 
hold  quantization  a  threshold  level  is  establish¬ 
ed  and  only  those  transform  domain  samples 


whose  magnitude  are  greater  than  the  thres¬ 
hold  are  coded. 


(b) 


Figure  5.  Slant  transform  of  an  image:(a) 
original;  (b)  transform  threshold 
display. 

Figure  6  presents  a  statistical  evaluation 
of  the  coding  performance  of  the  Walsh-Hada- 
mard,  Karhunen-Loeve:  and  Slant  transforms 
for  a  form  of  zonal  quantization  in  which  the 
transform  domain  samples  in  a  zone  are  cod¬ 
ed  with  six  bits  per  sample  and  samples  out¬ 
side  the  zone  are  discarded.  Ths  zone  is  de¬ 
fined  to  contain  the  transform  domain  samples 
with  the  larges  expected  variance,  and  is 
adjusted  to  include  25%  of  the  total  number  of 
transform  domain  samples.  Images  coded 
with  this  system  require  an  average  coding  of 
1.  5  bits  per  element.  Figure  6  plots  the 
mean  square  error  resulting  from  this  quanti¬ 
zation  process  as  a  function  of  the  size  of  the 
image  block  transformed.  From  the  figure  it 
is  seen  that  the  Karhunen-Loeve  trans'  ,rm 
provides  the  minimum  mean  square  error, 


Figure  6.  Mean  square  error  performance 
of  image  transforms  as  a  function 
of  block  size  for  low  pass  zonal 
quantization. 

but  the  Slant  transform  results  in  only  a 
slightly  greater  error.  Also  to  be  noted  is 
that  the  rate  of  decrease  in  mean  squar  r  error 
for  larger  block  sizes  becomes  quite  small 
after  a  block  size  of  32  by  32  elements. 

Several  computer  simulations  have  been 
performed  to  evaluate  the  Slant  transform  for 
image  coding.  Figure  7  showb  image  recon¬ 
structions  for  the  Walsh-Hadamard,  Karhunen- 
Loeve,  and  Slant  transforms  for  zonal  quanti¬ 
zation  employing  eight  zones  and  coding  with 
an  average  of  only  1.  5  bits  per  element.  Sub¬ 
jectively,  the  Slant  transform  results  in  much 
less  degradation  than  the  Walsh-Hadamard 
transform  and  only  slightly  more  than  the  Kar¬ 
hunen-Loeve  transform.  Similar  experiments 
have  been  performed  for  color  images,  and  it 
has  been  found  that  a  color  image  can  be  cod¬ 
ed  with  about  2.  0  bits  per  element  with 


negligible  degradation  using  the  Slant  trans¬ 
form. 


Summary 


(c) 


Figttig  7.  Reduced  bandwidth  images  obtain¬ 
ed  by  transform  coding  with  zonal 
quantization,  1.  5  bits/pixel,  (a) 
Walsh-JIadamard  coded;  (b)  Slant 
coded;  (c)  Karnunen-Loeve  coded. 


A  new  orthogonal  image  transform  with  a 
basis  vector  matched  to  gradual  brightness 
changes  along  image  lines  has  been  developed. 
The  transform  cap  be  computed  using  a  fast 
computational  algorithm,  and  requires  only  a 
few  more  operations  than  the  Walsh-Hadamard 
transform.  A  statistical  analysis  indicates 
that  the  Slant  transform  provides  a  smaller 
mean  square  error  for  image  coding  than  the 
Walsh-Hadamard  transform  and  a  slightly 
greater  error  than  the  Karhunen-Loeve  trans¬ 
form.  The  analytic  image  coding  oerformance 
predictions  are  verified  by  computer  simula¬ 
tions  of  image  coding  processes  for  mono¬ 
chrome  and  color  images. 
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Since  detailed  apprehension  of  the 
physical  world  depends  critically  upon 
vision,  it  is  not  surprising  that  in¬ 
vestigators  from  many  fields  are  cur¬ 
rently  exploring  image  processing.  Ap¬ 
plications  include  radiography,  earth 
resources  data  gathered  by  satellites, 
spectrum  analyzers,  reconnaissance  pic¬ 
tures,  facsimile,  remotely  piloted  vehi¬ 
cles,  and  others.  The  objectives  are 
typically  data  compression  or  image  en¬ 
hancement.  Use  of  the  Walsh  and  Fourier 
transforms  is  a  promising  new  tool,  but 
to  date  this  has  entailed  either  large- 
scale  digital  computers  or  relatively 
long  processing  times. 

Since  the  feasibility  of  these  tech¬ 
niques  has  already  been  demonstrated, 
there  is  considerable  emphasis  upon  ob¬ 
taining  practical  implementations  in  the 
form  of  lcw-cost,  high-speed  special 
hardware.  A  previous  paper  (1)  suggoet- 
ed  that  it  was  advantageous  to  apply  1-D 
(one  dimensional)  transforms  to  images. 
There  are  in  existence  special  process¬ 
ors  which  can  form  the  1-D  Fast  Walsh 
and  Fourier  Transforms  (FWT  and  PFT). 
Furthermore,  a  1-D  transform  processor 
affords  a  better  fit  with  current  image 
scanning  devices.  Consider  for  instance 
TV  sensing  devices  which  provide  a  read¬ 
out  one  line  at  a  time.  Ideally  this 
data  would  be  entered  into  a  FWT  or  FPT 
procossor  as  it  is  generated  and  pro¬ 
cessed  on-line. 

In  order  to  avoid  the  requirement  for 
extremely  large  memories,  it  is  conveni¬ 
ent  to  partition  the  picture.  It  will 
be  shown  that  applying  the  1-D  FWT  to 
each  of  tha  partitions  is  actually  equi¬ 
valent  to  taking  the  2-D  FWT.  In  addi¬ 
tion  this  can  be  carried  out  in  an  adap¬ 
tive,  iterative  manner  which  provides  in¬ 
sight  into  the  mechanism  of  compression. 
The  extent  to  whioh  this  also  applies  to 
the  PFT  will  be  indicated. 


There  are  three  motivations  for  ase  of 
the  1-D  FWT  in  imagery  analysis* 

(1)  Compatibility  with  existing  pic¬ 
ture  scanning  equipment, 

(2)  Reduction  in  the  amount  of  high¬ 
speed  Kemory  required,  and 

(3)  On-line  processing  of  the  image. 


be  entered  as  a  series  of  lints  into  an 
array  of  all-semiconductor  processors, 
where  proceeeing  would  occur  immedia¬ 
tely.  Almost  at  the  conclusion  of  the 
scan,  the  FWT  spectral  components  would 
be  available  for  manipulation  either  for 
compression  or  image  enhancement.  In 
contrast,  were  the  regular  2-D  FWT  of 
the  image  to  be  formed,  two  scans  of  the 
picture  would  be  required  —  one  hori¬ 
zontally  and  one  vertically.  Thus  for 
an  image  with  1,000  horizontal  and  vort¬ 
ical  elements,  one  million  locations  of 
storage  are  implied.  In  turn,  this  sug¬ 
gests  some  type  of  bulk  storage,  immedi¬ 
ately  degrading  overall  speed. 

Partitioning  of  the  picturo  has  been 
proposed  (2,  3;  »b  a  method  of  overcom¬ 
ing  the  memory  requirement.  The  image 
is  broken  up  into  a  number  of  pieces  of 
size  perhaps  16x16  elements  and  the  tran¬ 
sform  taken.  An  alternative  described 
(.1)  is  to  wort  with  narrow  strips  of  the 
original  picture  extending  from  the  left 
border  to  the  right  border.  This  would 
be  consistent  with  conventional  scanning 
methods  and  also  is  more  suitable  for 
some  1-D  processor  designs,  in  particu¬ 
lar  the  cascade.  Justification  for  ap¬ 
plying  the  1-D  FWT  follows  from 

Theorem*  Let  f(i,j)  represent  the  in¬ 
tensity  samples  of  an  image  with  N  *2 
elements  in  each  dimension  and  M«  r  In 
all.  Then  the  W&lsh  Transform  (WT)  can 
be  calculated  equivalently  from 

F(u,v)  »  Hj^fd.jjHjj  or 

F(u,v)'  *  Hjjfd.j)*, 

where  Hj.  and  Kv  are  Hadamard  matrices 
and  F(uvv)*  ana  f(i,j)f  are  column  vec¬ 
tors  formed  from  the  rows  of  the  corres¬ 
ponding  matrices  and  with  the  elements 
ordered  as  shown  in  Fig.  7. 

Discussion* 

Hadamard  matrices  and  their  use  in  the 
computation  of  the  WT  are  discussed  in 

(4).  The  Kronecker  or  direct  product  of 
matrices  can  be  illustrated  at  follows* 


+1  +1  +1  +1 
+1  -I  +1  -lj 
H4  *  +1  +1  -1  -lj 
+1  -1  -1  +1 


By  means  of  the  1-D  FWT  the  image  would 
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where  «  H2xH2,  the  direct  product. 

„  K«* 

"4  |+Hj  -*2J 

Proceeding  inductively# 

♦H4  +'%  +!!4 
+H4  -H4  +H4  -Km 


H1 6  *  +H4  +H4  -H4  -H4 

Uh4  -h4  -h4 

A*  mi  illustration  of  the  theorem,  con¬ 
sider?  the  image 


f(i.j) 


f001ClfP2f03 

f10fll*12f13 


f20#21f22f23 


£30*31*32*33] 

Then  the  WT  can  fee  computed  either  tie 
F(u,v)  3  H4i’{4.,J/H4  or 

?(u  v>**  H^KiJ/1. 

Proofi 

The  method  of  proof  is  by  explicit 
correspondence  between  terms  of  the  two 
representations.  Consider  ■  singie  te,/* 
F(mPn)  from  the  matrix  Vfu,v).  In  order 
to  evaluate  it,  firet  fH,j)H4  ia  form¬ 
ed.  Ita  nth  column  can  be  written 

rfOO+f01~f02_:rol 


f10+*ll* 


*12‘*13 


F20+f2l”:f22"f2^ 

30+*3l”*32""*3_3j 

when  n  haa  been  chosen  equal  to  2.  It 
io  important  to  note  that  the  sign  pat¬ 
tern  ia  repetitive.  If  the  operation  ia 
now  completed  by  the  matrix  multiplica¬ 
tion  by  Hj.  in  front,  eaaentially  the 
mth  row  of  H4  ia  multiplied  term  by  term 
with  the  abo$e  column  to  yield  (m  *  1) 

+^+f0Q+*  01" *02"*  03 )  "^*10+*ll"*12"*13  * 

+( +t 20+f 21”* 22"* 23 ^  ~ *  *30+*3l”*32"*33 *  * 

Thua  the  term  F(m,n)  can  be  identified 
aa  a  collection  of  all  the  term*  of  the 
matrix  f(i.j)  grouped  by  row*.  The  *ign 
pattern  before  each  row  i*  that  of  th* 
mth  row  of  H4  and  the  sign  pattern  with¬ 
in  each  row  is  that  of  the  nth  row  «— 
.voting  that  H4  is  aymmetric. 

Next  K.^fU.j)*  is  to  be  evaluated, 
and  in  particular  its  (m,n)th  term  . 

Now  if  H,*  is  expressed  as  above  as  the 
direct  product  of  H4  with  itself,  it  is 
immediately  apparent  that  the  sign  pat¬ 
tern  of  the  4xa  +  nth  row  is  exactly 
the  same  as  that  of  H4f(i,j)H4.  This  is 
sufficient  to  prove  tne  equivalence.  It 
should  be  remarked  that  th®  theorem  is 
also  valid  for  rectangular  images. 


Partitioning  a  given  image  into  a  sat 
of  smaller  squares  in  order'  to  take  tho 
transform  it  of  interest  both  beoause  of 
hardware  simplification  and  greater  com¬ 
pression  ratios  (2,2)«  Although  the  em¬ 
phasis  of  this  paper  is  upon  1-D  trans¬ 
forms,  it  ic  instructive  to  examine  at 
first  ths  use  of  square  subregion*.  It 
haa  been  claimed  that  this  procedure  ia 
in  a  sense  adaptive,  meaning  that  "busy* 
regions  ore  represented  by  mors  spectral 
components  than  rather  simple  regions. 

In  what  follows  it  will  be  shown  that  it 
is  possible  to  use  partitioning  in  a  tru¬ 
ly  adaptive  say  in  the  sense  that  the 
best  sits  of  the  subregions  is  estab¬ 
lished  by  the  content  of  the  picture. 

An  algorithm  can  be  established  so 
that  it  is  not  necessary  to  choost  in  ad- 
vanes  the  exact  site  of  the  subregion* • 
The  method  involves  building  ths  FttT  up¬ 
ward  and  outward.  The  starting  point  is 

%*i-iisWd  •~b*H 

jp  dj  j  p+b-c-d  a-b-c+dj 

which  is  the  4-point  transform.  Pro¬ 
ceeding  by  induction-,  consider  sow  the 
W  cf  a  partition  measuring  2Nz2N  is  to 
be  formed i 


nbin 

But  H2N  ■  Hj^xKjj  so  that  the  above  is 

P0  P1  pN  Hh 

yv lb  ?2iiy^ 

TI.=s  first  tsrm  of  the  resulting  matrix  is 

'•nW  ViV  V2V  ^2^ 

with  the  other  terms  being  similar  except 
for  the  sign  pattern,  which  is  on*  of 
++++,  +-+->,  ++~,  or  + — +•  Hence  the  al¬ 
gorithm  can  be  stated  that  starting  with 
the  transforms  of  NxN  regions « 

Vi1^ 

^2%  HNP3^j 

ths  transform  of  th*  2Nx2N  region  is  car¬ 
ried  out  by  combining  corresponding  terms 
from  th*  four  quadrants  exactly  as  in  th* 
4-point  transform  above. 

This  procedure  is  illustrated  in  Fig. 

1.  The  FWT  is  calculated  by  first  com¬ 
bining  elements  separated  a  distance  1, 
then  a  distance  2,  then  4,  etc.  The  ad¬ 
vantage  of  this  formulation  is  that  the 
greatest  correlation  is  expected  between 
adjacent  elements*  As  the  process  contin¬ 
ues,  mors  distant  regions  are  combined. 

But  ths  procedure  can  be  halted  when  it 
no  lenger  gives  effective  conprecsicn. 
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Baaed  upon  results  of  K.C.  Peace, 
Rushforfch  ( 5)  proposed  a  1-0  factorisa¬ 
tion  of  the  FWT  which  waa  utilised  in 
(1)  in  an  implementation.  It  will  new 
bo  shewn  how  this  factorisation  can  be 
modifisd  in  analogy  with  the  roaults  of 
the  preceding  section  to  achieve  build¬ 
ing  the  FWT  “outward"  from  adjacent  sam- 
plea.  This  le  in  contrast  with  the  nor¬ 
mal  aethod  of  computing  the  PPT  whore  the 
first  step  involves  combining  samples 
separated  by  a  distance  N/2.  The  purpose 
once  again  is  to  permit  adaptive  proced¬ 
ures  with  respect  to  subregion  selection. 

Pease  expressed  H„  as  follows) 

Hjj  »  C(PCP"1)(p2cP'2)...Pn"1CP*’(n''2'> 

«  (CP)n, 

where  C*s  effect  upon  a  vector  ia  to  re¬ 
place  successive  pairs  of  components  by 
the  sum  and  difference  respectively  and 
P  ia  the  perfect  shuffle.  Pfl  for  example 
operating  on  0,1#2,3,4,5,6,7  yields 
0.4,l,5f2(,6,3,7  *s  in  shuffling  cards. 

It  is  desired  to  replace  P  by  P-1. 

This  can  be  justified  ag  follows* 


Since  0  is  its  own  inverse  except  for  a 
factor  of  2. 

P'aC3P  *  21. 

Hence  (P"’1C)aHN  -  (P_iC)tt(CP)n-«  NX. 

Sinoo  K»  is  its  own  inverse  except  for 
the  factor  N,  it  follows  that 

H,,  » 

The  sffeet  «f  P  oa  a  vector  can  be 
illustrated  for  the  case  P£xs 
0,1.2, 3.4,5, 6,?  becomes  0.2,4, 6.1»3*5t?. 
A  second  application  yields 
0.4,1, 5, 2,6.3, 7.  The  serial  implementa¬ 
tion  would  bo 


^Hi?raai5T8g~~^ 


A/S 


Fig. 2  Serial  FWT 

A/S  indicates  an  adder/subtraeter.  and 
the  Shift  Registers  hold  ths  samples. 

The  bits  making  up  each  sample  can  be 
stored  in  parallel  SR* a  which  art  shifted 
simultaneously.  In  n  steps  with  the  data 
being  moved  back  and  forth  the  PWT  is 
taken.  Only  the  connections  for  saving 
from  the  upper  SR  to  the  lower  are  shewn. 


Application  to  Xwsgfir? 


Use  of  the  1-0  FWT  in  imagery  analysis 
will  now  be  briefly  discussed.  Assume 
the  inage  measures  1024x1024  elements. 

It  can  be  partitioned  into  strips  hori- 
e on tally  measuring  1024x8.  say.  Assum¬ 
ing  8-bit  trorde  and  an  LSI  chip  sise  ca¬ 
pable  of  storing  4096  bits.  16  LSI  chips 
are  required  for  each  SR  of  Pig.  2.  For 
each  section  of  tha  picture,  the  F5T  is 
taken  and  the  spectral  components  are 
manipulated  either  for  purposes  of  data 
compression  or  image  enhancement.  For 
the  former  a  threshold  is  established  so 
that  the  weaker  components  arm  set  equal 
to  zero  and  the  others  run-length  encod¬ 
ed.  For  image  enhancement  certain  se- 
qvencies  are  amplified  and  others  atten¬ 
uated.  See  Fig.  3  for  8x8  images. 
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Working  with  tho  1-D  FWT  these  row* 
should  ho  visualisad  plaeod  ono  after  an¬ 
other.  Doing  th*  number  of  sign  changes 
as  equivalent  to  sequency,  th*  following 
sequencie*  can  ho  Resigned  tho  patterns: 

0  15  16  31  32  47  48  63 

1  14  17  30  33  46  49  62 

2  13  18  29  34  45  50  61 

3  12  19  28  35  44  51  60 

4  11  20  27  36  43  52  59 

5  10  21  26  37  42  53  58 

6  9  22  25  38  41  54  57 

7  8  23  24  39  40  55  56 

Fig.  4  Sequtnoies 

After  application  of  th*  FWT  the  se¬ 
quences  occur  in  bit-reversed  order: 


* 


1 

5 

1 

7 


32  16  48 

36  20  52 

34  IS  50 

38  22  54 

33  12  49 

37  21  53 

35  12  51 

39  23  55 


15  47  21  63 

11  43  2?  59 

12  45  12  61 
9  41  25  57 

46  2&  62 
0  42  25  58 
12  44  28  60 
“  40  24  56 


Fig.  5  Bit-Reversed  Order 


The  sequencies  underlined  in  Fig.  5 
arc  those  of  the  upper  loft  quadrant  of 
Fig.  3  and  4.  Thee*  are  th*  err/reneies 
which  are  usually  th*  «trong**  ,4).  Th* 
reason  for  this  can  b«  sesn  from  the  al¬ 
gorithm  demonstrated  in  Fig.  1.  If 
thore  is  redundancy  in  the  picture,  then 
as  in  Fig.  lh  the  very  first  step  leads 
to  four  interleaved  images  which  ar* 
thereafter  separately  processed.  But  of 
the  four  one  tends  to  he  far  stronger 
when  there  is  strong  correlation  from 
one  element  to  the  adjacent  one.  If  ev¬ 
ery  other  point  of  Fig.  la  is  ehossn  and 
th*  FWT  formed,  then  after  scaling  the 
result  is  quite  comparable  to  selecting 
every  other  point  of  Fig.  id.  Henoc,  in 
a  very  meaningful  way,  data  compression 
by  threshold  sampling  the  FWT  is  related 
to  redundancy  reduction.  The  advantage 
of  the  adaptive  procedures  recommended 
her*  is  that  they  adjust  to  different  a- 
mounta  of  redundancy  automatically. 

The  extent  to  which  the  above  general¬ 
ises  to  the  FFT  is  of  interect.  However 
it  is  not  true  that  the  1-0  and  2-0  FFT's 
are  equivalent.  Despite  this  it  is  still 
prepessd  to  use  the  1-0  FFT  in  working 
with  images  for  the  reasons  stated  at  the 
beginning  of  this  report.  Special  pur¬ 
pose  hardware  is  much  more  effective 
than  general  purpoec  computers  in  com¬ 
puting  th*  FFT.  To  date  these  special 
processors  have  been  designed  to  take 
the  1-0  FFT. 

Interesting  enough,  there  is  a  form 
of  th*  FFT  in  which  the  1-1)  and  2-0  FFT 
are  equivalent.  This  work  was  carried 
out  by  Good  (6,7)  who' pointed  out  th* 


relationship  'ertween  dimensionality  and 
the  formulations  of  the  FFT.  H#  sxplor- 
th*  equivalency  of  expressions  of  the 
form 


A,  ■  £  v" 


*.  * 

If  the  variables  with  subscript  1  rang* 
from  0  to  t^-1  and  those  with  subscript 
2  from  0  to  t2  *  •1 ,  wh#r*  t  »  tjto#  and 
tx  and  ar*  relatively  prime,  then  the 
expressions  are  equal,  w,  w^,  w2  are 
the  corresponding  principal  roots  of  un¬ 
ity. 


In  order  to  prove  this  relationship 
Good  made  use  of  the  Chinese  remainder 
theorem  to  establish  the  relationship 
between  s  and  the  s^.  In  the  two-dimen¬ 
sional  oaae  illustrated,  r  is  given  by 

r  »  tgr^  +  tjTg  (mod  t). 

Thus  if  ti  ■  3  and  to  ■  8,  r  is  shown 
in  th*  following  table: 

01234567 

0:  0  3  6  9  12  15  18  21 

1:  8  11  14  17  20  23  2  5 

2t  16  19  22  1  4  7  10  13 

Fig.  6  Good  Relationship 

Two  reasons  for  not  using  this  form¬ 
ulation  can  be  given.  The  first  is  th* 
order  in  which  the  samples  are  taken 
and  the  second  is  that  the  moduli  must 
be  relatively  prime.  In  other  words, 
hardware  considerations  suggest  that  it 
is  better  to  use  the  Cooley-Tukey  form 
despite  the  "twiddle"  factor  that  makes 
th*  1-0  and  2-D  versions  different.  Th* 
method  of  scanning  samples  then  becomes 

01234567 

8  9  10  U  12  13  14  15 
16  17  18  19  20  21  22  23 
24  25  26  2?  28  29  30  31 

Fig.  7  Proposed  Soan 

Having  made  th*  decision  to  us*  th* 
1-D  FFT,  the  question  arises  as  to  whe¬ 
ther  it  will  permit  the  same  flexibility 
in  image  manipulation  as  the  2-D  FFT.  In 
particular,  it  is  worth  looking  at  data 
compression.  Assume  that  in  Fig.  ?  th* 
second,  third,  and  fourth  rows  are  high¬ 
ly  correlated  with  th*  first,  i.e.  they 
ar*  almost  identical.  The  implications 
can  be  seen  from  tho  flow  graph  for  th* 
FFT  corresponding  to  Decimation  in'  Fre¬ 
quency.  During  th*  first  stag*  samples 
0  and  16  will  be  added  and  subtracted, 
then  1  and  17,  stc.  This  will  set  to 
sero  half  th*  speotral  components.  Dur¬ 
ing  th*  second  stage,  half  th*  remainder 
will  also  be  set  to  sero.  Hence  there 
results  a  4:1  compression.  Depending  up¬ 
on  the  correlation  of  samples  along  the 
first  row,  it  is  possible  that  addition¬ 
al  compression  can  be  obtained. 
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In  a  recent  paper  (8)  the  FFT  was  com- 
•bined  with  partitioning  of  tho  image  in 
order  to  achieve  picture  bandwidth  com- 
preeeion.  After  some  experimentation 
subregion*  of  site  16x16  were  explored 
in  further  depth*  asvl  actual  eoaputer 
•  simulation  we*  conducted.  For  each  sub¬ 
region  the  standard  deviation.  L.  of 
the  picture  staples  was  eoaputed  to  with¬ 
in  a  constant  and  for  that  region  the 
number  of  Fourier  spectral  coaponents 
selected  was  proportional  to  L.  In  this 
sense  the  procedure  was  adaptive. 

A  problea  identified  with  partition¬ 
ing  was  edge  effects.  Because  the  Four¬ 
ier  trsnsfoxn  is  equivalent  to  a  Fourier 
aeries  expansion,  differences  in  bright¬ 
ness  between  opposite  edges  act  like  a 
discontinuity  requiring  a  substantial 
nuaber  of  spectral  coaponents  to  repre¬ 
sent  it.  A  possible  solution  proposed 
was  to  add  an  extra  row  and  column  in 
order  to  permit  interpolation,  but  it 
was  noted  that  this  would  not  be  consis¬ 
tent  with  the  FTC  algorithm. 

Although  the  use  of  a  1-D  FFT  was  i- 
dentified  in  (8)  as  permitting  substan¬ 
tial  hardware  simplifications,  it  aw 
noted  that  along  an  entire  horixontal 
line  there  would  surely  be  a  larger  va¬ 
lue  of  L.  thus  requiring  more  spectral 
coaponents  to  represent  it.  as  compared 
with  arranging  the  saae  nuaber  of  sam¬ 
ples  into  a  more  square-shaped  region. 

Nevertheless,  the  hardware  considera¬ 
tions  previously  discussed  make  a  strong 
case  ‘or  the  1-D  FFT.  For  example,  with 
reaper  to  edge  effects,  it  would  be 
possible  to  replace  the  right  column  of 
the  picture  with  an  interpolated  column 
whereas  this  cannot  be  don*  in  the  cen¬ 
ter  of  a  picture.  This  step  in  Itself 
could  possibly  compensate  for  the  dis¬ 
advantage  of  working  with  a  atrip  com¬ 
pared  to  a  square. 

QfflttlMlWf 

Hardware  simplifications  can  be  ob¬ 
tained  through  applying  1-D  rather  than 
2-D  FWT  and  FFT  techniques  in  imagery 
analysis.  The  goal  is  to  permit  on¬ 
line  isag*  manipulation  by  special  pro¬ 
cessors.  For  the  NT  the  1-D  method  and 
ths  2-D  method  are  shown  to  be  equi¬ 


valent.  Algorithms  for  partitioning 
pictures  adaptively  for  purposes  of 
data  compression  and  image  manipulation 
wars  described  and  illustrated.  It 
was  possible  to  demonstrate  th*  aathod 
by  which  threshold  sampling  of  FWT 
speotral  components  removes  redundancy  ' 
froa  a  picture.  y‘ 

For  the  FFT  it  is  not  true  that  the 
1-D  and  2-D  transforms  are  th*  saae  when 
using  ths  Coolsy-Tuksy  algorithm.  Al¬ 
though  they  are  identical  in  th*  Good 
formulation  of  th*  FFT.  it  was  concluded 
that  it  would  be  better  to  utilise  the 
former.  From  th*  flow  chart  for  Decima¬ 
tion  in  Frequency  it  can  be  shown  that 
the  1-D  FFT  applitd  to  an  image  and  fol¬ 
lowed  by  threshold  sampling  will  result 
in  a  good  compression  ratio.  The.  re¬ 
lative  efficiencies  of  1-D  and  2-D  PFT*s 
were  briefly  discussed,  but  it  does  not 
seem  possible  to  resolve  this  question 
without  a  careful  simulation  study. 
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Introduction 

The  use  of  conventional  pulse-code 
modulation  techniques  to  transmit  tele¬ 
vision  signals  requires  a  very  wideband 
transmission  medium.  Therefore,  new 
bandwidth  compression  (or,  equivalently, 
bit-rate  reduction)  techniques  have 
been  explored  for  digital  transmission 
of  television  signals. 

Reduction  of  the  bit  rate  required 
for  the  transmission  of  a  television 
channel  is  possible  if  the  coefficients 
obtained  from  a  suitable  orthogonal 
transform  of  the  television  signal  are 
properly  coded.  The  advantage  of  using 
an  orthogonal  transformation  depends 
on  the  suitability  of  the  transformation 
for  the  representation  of  the  signal  and 
the  simplicity  of  the  implementation. 

The  overall  performance  can  then  be 
judged  by  using  conventional  PCM  as  a 
reference. 

With  the  development  of  high-speed 
digital  computers,  various  transformations 
have  recently  been  explored  by  computer 
simulation  for  possible  bit-rate  reduc¬ 
tion.  The  well-known  Fourier  transform, 
which  can  be  computed  very  rapidly,  is 
typical  of  the  orthogonal  transforms 
which  are  being  studied.  Although  the 
FFT  algorithm  i3  very  efficient,  its 
implementation  is  not  simple.  However, 
the  Fourier  transform  of  an  image  can 
be  practically  determined  by  using  a 
coherent  optical  cvstem. 

Another  transformation  which  can  be 
computed  very  rapidly  is  the  discrete 
Walsh  or  Hadamard  transformation  which 
dees  not  require  any  multiplication 
operations.  Alternatively,  the  tele¬ 
vision  signal  may  be  considered  as  a 
random  process  and  the  eigenvectors 
derived  from  the  covariance  matrix 
of  the  process  may  be  used  to  represent 
the  signal.  This  transform  is  known  * 
as  the  Karhunen-Lofive  transform. 

The  application  of  linear  transforma¬ 
tion  and  block  quantization  to  image 
bandwidth  reduction  problems  has  been 
studied  by  several  researchers.  A 
partial  bibliography  pertaining  to  Walsh- 
Hadamard  processing  is  given  at  the  end 
of  this  paper. 


In  this  paper,  the  application  of 
Walsh  transform  processing  has  been 
investigated  by  using  a  flying  spot 
scanner  and  a  general-purpose  computer. 

A  full  image  frame  of  512  x  512  elements 
has  been  subdivided  into  1024  16  x  16 
blocks,  which  are  processed  by  the  two- 
dimensional  Walsh  transformation.  To 
minimize  the  mean-square  error  caused 
by  quantization,  the  bit  distribution  in 
the  transform  domain  is  made  in  accor¬ 
dance  with  the  variances  of  the  coeffici¬ 
ents,  with  the  constraint  that  the  total 
number  of  bits  should  not  exceed  a  given 
maximum.  This  maximum  is  determined  by 
considering  PCM  transmission  of  the  same 
image.  The  error  caused  by  intensity 
quantization  has  been  computed  by  com¬ 
paring  the  input  and  output  intensity 
values  for  each  line  of  the  entire  frame. 

For  the  Walsh  transform  the  error  caused 
by  quantization  of  the  coefficients  has 
been  computed  by  comparing  the  input 
and  output  intensity  values  over  each 
block  of  the  entire  frame.  A  reduction 
in  the  quantizing  noise  has  been  verified 
by  using  transform  domain  processing 
instead  of  spatial  domain  processing. 

Applications  of  the  two-dimensional 
discrete  Courier  and  Karhunen-Lofeve 
transformations  have  also  been  investiga¬ 
ted  by  using  the  same  block  size  of  N  *  16 
samples.  The  Karhunen-Lodve  transformation 
is  most  effective  in  reducing  the  contours 
resulting  from  quantizing  noise,  but  its 
implementation  is  most  complex.  The 
Walsh-Hadamard  transformation  is  the 
simplest  to  implement  and  significantly 
reduces  the  contours  at  low  bit  rates. 

Two-Dimensional  Discrete  Walsh 
Transformation  ” 

Let  f(x,y)  represent  a  two-dimensional 
square  array  of  values  obtained  by 
sampling  the  brightness  of  an  image  at 
N  x  N  points.  (The  value  used  for  N  is 
16.)  Assume  that  F(j,k)  ic  the  two- 
dimensional  Walsh-Hadaraard  transform 
of  f(X,y).  Mathematically,  such  a  two-  > 
dimensional  discrete  Walsh  transform 
pair  is  defined  as 
.  N-l  N-l 

F (j ,k)  -  -*■  I  I  f(x,y)  wal (j ,x)  wal(k,y) 
N  x=0  y=0 

j,  k  -  0,  1,  .  .  .,  N  -  1  (1) 
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N-l  N-l 

f(x,y)  *  £  I  F(j ,k)  wal(j,x)  wal(k,y) 

j«0  k«0 

x,y  *  0,  If  .  •  • i  N  *  1  (2) 

where  wal(j,x)  and  wal(k,y)  represent  the 
one-dimensional  Walsh  functions  in  the  x 
and  y  directions,  and  j  and  k  are  the 
numbers  of  zero  crossings  of  the  Walsh 
functions  in  the  x  and  y  directions, 
respectively.  The  coefficient  correspon¬ 
ding  to  j  «  k  »  0, 

.  N-l  N-l 

F(0,0)  -  Z  Z  f (x,y) 

m  x*°  ya° 


yields  the  average  brightness  of  the  N  x 
N  block  and  is  identical  to  the  zero 
spatial  frequency  term  in  the  two-dimen¬ 
sional  discrete  Fourier  domain. 

The  application  of  the  two-dimensional 
Walsh  transform  can  be  visualized  as  a 
comparison  of  the  brightness  pattern  of 
each  16  x  16  image  block  with  the  various 
two-dimensional  Walsh  basis  patterns 
for  N  *  16.  Walsh  basis  patterns  for 
N  =  8  are  shown  in  Figure  1.  The  coe¬ 
fficient  corresponding  to  the  basis 
wal(l,x)  wal(0,y)  represents  a  comparison 
of  the  brightness  of  the  left  and  right 
halves  of  the  N  x  N  block.  The  coeffi¬ 
cient  corresponding  to  the  basis  wal(0,x) 
wal(l,y)  represents  a  comparison  of  the 
brightness  of  the  lower  and  upper  halves 
of  the  image  block.  Finally,  the  coeffi¬ 
cient  corresponding  to  the  wal(N  -  1,X). 
wal(N  -  l,y)  basis  represents  a  comparison 
of  the  image  block  with  an  N  x  N  checker¬ 
board  design,  as  shown  in  the  upper 
right  corner  of  Figure  1.  This  coefficient. 


of  image  in  the  Walsh  domain,  are  quan¬ 
tized  „y  using  a  certain  bit  distribution, 
and  the  processed  image  is  reconstructed 
as  two  consecutive  one-dimensional  trans¬ 
forms,  first  in  the  k  direction  and  then 
in  the  j  direction. 

Quantization  of  the  Walsh  Coefficients 

Thresholding  magnitudes  of  the  coeffi¬ 
cients  in  the  transform  domain  makes 
bit-rate  reduction  possible.  .That  is, 
the  coefficient  is  transmitted  if  its 
energy  is  above  the  threshold  and  not 
transmitted  if  its  energy  is  below  the 
threshold. 

For  high-quality  image  transmission 
every  coefficient  must  be  considered 
in  terms  of  its  importance  in  image  recon¬ 
struction.  Since  the  amount  of  informa¬ 
tion  contained  in  each  coefficient  is 
proportional  to  its  energy,  bit  distri¬ 
bution  and  hence  allotment  of  the  quan¬ 
tization  levels  should  be  made  in  accor¬ 
dance  with  the  variances  of  the  coeffi¬ 
cients.  This  procedure  also  minimizes 
the  rms  error  at  any  given  bit  rate.1 

The  total  quantizing  noise  caused  by 
quantized  transmission  of  the  N  x  N 
block  of  image  is 


F<|,§)  -  V  V 

c  *  N*  x=«0  y=0 


f(x,y) 


is  identical  to  the  spatial  folding 
frequency  term  in  two-dimensional  dis¬ 
crete  Fourier  transform  processing. 

Since  the  transformation  kernel, 
wal(j,x)  wal (k,y) 

is  separable,  the  transform  can  be 
applied  an  two  consecutive  one-dimen¬ 
sional  transforms.  Therefore,  trans¬ 
formation  coefficients  of  each  block  are 
computed  by  applying  the  one-dimensional 
Walsh  transform,  first  in  the  x  direction 
to  every  line,  and  then  in  the  y  direction 
to  every  column  of  the  first  transfor¬ 
mation.  If  the  Hadamard  transform  in 
natural  order  is  used  in  the  x  direction, 
the  coefficients  should  be  sequency  - 
ordered  before  it  is  applied  in  the  y 
direction.  The  resulting  N  x  N  coeffi¬ 
cients,  which  represent  an  N  x  N  block 


—  _  1 
e'  -  — y 
n 


.1.  K. 

1=0  l 


where  is  a  constant  depending  on  the 
quantizer  structure  used  for  quantizing 
the  ith  coefficient,  is  the  variance 
of  the  ith  coefficient,  and  ni  is  the 
number  of  bits  assigned  to  the  ith 
coefficient. 

Bits  are  distributed  in  the  transform 
domain  so  that  the  total  quantizing 
noise  given  by  equation  (3)  is  minimized. 
The  average  number  of  bits. 


is  determined  by  considering  PCM  trans¬ 
mission  of  the  N  x  N  block  of  image. 

In  PCM  transmission  of  an  image, 
the  spatial  domain  samples  are  quantized 
by  using  M  bits  per  sample.  The  total 
number  of  bits  required  to  transmit 
ai  N  x  N  block  of  frame  is  then 


Typical  values  chosen  for  M  are  seven, 
four,  and  two  bits  per  sample;  thus 
the  total  numbers  of  bits  used  for  N  “ 
16  are  B  -  1792,  1024,  ond  512,  respec¬ 
tively.  In  order  to  evaluate  the 


W'\ 

t:--\ 


signal-to-quantization  noise  performance 
of  orthogonal  transform  processing  on  the 
same  image,  the  coefficients  are  assigned 
bits  according  to  their  variances  and  the 
constraint  that  the  total  numbers  of  bits 
are  1792,  1024,  and  512,  resulting  in 
averages  of  seven,  four,  and  two  bits  per 
picture  element,  respectively. 

Experimental  Results 

A  moonscape  slide  has  been  scanned 
by  a  flying  spot  scanner  to  produce  an 
array  of  Lx  L  (L  =  512)  uniformly  spaced 
samples  of  image  brightness.  Next,  a 
general-purpose  computer  has  been  used 
to  perform  spatial  domain  or  transform 
domain  processing  on  this  array  of  data. 

Then,  the  processed  image  has  been 
reconstructed  by  the  flying  spot  scanner. 

The  moonscape  image  has  been  processed 
by  PCM  at  three  different  bit  rates: 

M  =>  7,  4,  and  2  bits  per  sample.  Figures 
2a,  2b,  and  2c  are  the  resulting  pictures 
for  each  of  these  cases.  Uniform  quanti¬ 
zing  with  a  mid-riser  has  been  employed 
in  each  case,  since  this  prevents  the  loss 
of  one  quantizing  step.  The  quantizing 
step  size  has  been  referenced  to  the 
full  black-to-white  range  observed  at 
the  flying  spot  scanner  output. 

Walsh  transformation  processing  has 
been  accomplished  on  small  N  x  N  (N  =  16) 
blocks.  Thus  there  are  p  =  (512  x  512)/ 

(16  x  16)  =  1024  such  blocks.  The  Walsh 
transform  of  each  block  has  been  computed 
to  obtain  the  coefficients  which  repre¬ 
sent  the  image  in  the  transform  domain. 

At  the  receiving  side,  the  spatial  domain 
samples  are  reconstructed  from  the 
quantized  coefficients  by  using  an  inverse 
transformation . 

Bit  distribution  in  the  Walsh  domain 
is  determined  by  coefficient  variances 
which  are  computed  by  ensemble  averaging 
over  the  total  number  of  blocks.  Three 
different  values  are  assigned  to  n^:  7, 

4,  and  2.  The  bit  distributions  for 
these  three  values  are  given  in  Tables  1, 

2,  and  3,  and  the  resulting  images  are 
shown  in  Figures  3a,  3b,  and  3c.  The 
zero  spatial  sequency  (or  frequency)  term, 
F(0,0) ,  has  the  highest  variance.  Therefore, 
it  is  assigned  the  highest  number  of 
quantization  levels  in  order  to  prevent 
the  appearance  of  block  structure  in  the 
reconstructed  image.  The  number  of  bits 
assigned  to  F(0,0)  appears  in  the  upper 
left  corner  of  each  table.  For  the  three 
cases  considered,  the  numbers  of  bits 
assigned  to  F(0,0)  are  14,  11,  and  9 
bits,  respectively. 

In  FCM  processing,  the  error  caused 
by  intensity  quantization  is  computed  by 
comparing  the  input  and  output  intensity 
values  for  each  line  of  the  entire  frame. 

For  the  discrete  Walsh  transform,  the 
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error  caused  by  quantization  of  the 
coefficients  is  computed  by  comparing  the 
input  and  output  intensity  values  over 
each  block  of-  the  entire  frame.  PCM  is 
used  as  a  basis  of  comparison  to  compute 
the  resulting  reduction  in  the  quantizing 
noise  ratio,  S/NQ.  For  the  three  cases 
considered,  the  5/Nq  was  reduced  by  7.9, 
3.1  and  1.6  dB,  respectively.  It  was 
observed  that  the  choice  of  the  quantizer 
parameters  is  critical  in  obtaining  a 
high  improvement  in  S/Nq* 

In  order  to  obtain  the  maximum  signal- 
to-quantizing  noise  ratio,  the 
amplitude  loading  factor  of  the  uniform 
quantizer  in  the  transform  demain  should 
be  dependent  cn  the  number  of  bits  assi¬ 
gned  to  the  coefficients.  If  a?  is  the 
variance  of  the  ith  coefficient,  the 
quantizer  spread  (defined  as  the  distance 
between  minimum  and  maximum  levels  of  the 
quantizer)  is  given  by 

Qs  -  2a.a.  (6) 

where  cq  is  the  amplitude  loading  factor 
of  the  ith  quantizer.  Table  4  gives  the 
S/N„  improvement  when  a  constant 
amplitude  loading  factor  is  used  for  every 
coefficient. 

An  alternative  method  of  processing 
at  an  average  rate  of  four  bits  per 
sample  wa  s  also  investigated.  This 
method,  which  consisted  of  assigning  new 
optimum  values  of  ai  (given  in  the 
appendix)  for  each  of  the  bit  assign¬ 
ments,  resulted  in  an  S/Nq  improvement 
of  4.1  dB,  which  is  1.0  dB  higher  than 
the  improvement  obtained  for  a  =  4. 

Summary  and  Conclusions 

Image  processing  using  two-dimensional 
discrete  Walsh,  Fourier,  and  Karhunen- 
Lofeve  transformations  is  performed  on 
a  moonscape  slide  at  nit  rates  averaging 
seven,  four,  and  two  bits  per  picture 
element.  At  all  bit  rates,  a  reduction 
in  the  quantizing  noise  is  verified 
by  using  transform  domain  processing 
instead  of  spatial  domain  processing. 

A  very  important  property  of  transform 
processing  that  is  not  revealed  in  S/Nq 
improvement  is  the  subjective  effect  of 
contouring.  It  is  basically  true  of 
all  of  the  orthogonal  transformation 
processing  methods  that  at  low  bit  rates 
the  effect  of  contouring  is  reduced 
because  each  picture  element  in  the- 
transformed  image  is  a  weighted  average 
of  N  two-dimensional  orthogonal  functions. 

Appendix 

The  range  of  a  quantizer  (referred  to 
as  the  quantiser  spread)  has  been  given 
by  equation  (6).  If  the  ith  Walsh 
transform  coefficient  is  assigned 
bits,  then  the  step  size 


auaer. 


■»  ft/ 


I®* 


of  a  uniform  quantizer  is 
„  _  2ai°i 


2ni 


(A-l) 


If  there  is  a  large  number  of  steps, 
then  the  mean-square  quantizing  noise 
error  is  one-twelfth  of  the  square  of 
the  step  size.2  That  is, 


0 

n 


(A-2) 


When  there  is  a  finite  number  of  steps, 

2ni,  the  expression  for  the  mean-square 
quantizing  noise  error  is  more  involved, 
since  the  probability  distribution  of  the 
coefficients  should  be  considered.  The 
probability  distribution  of  the  coeffi¬ 
cients  can  be  assumed  to  be  Gaussian,  since 
the  coefficients  are  obtained  from  a 
linear  combination  of  spatial  domain 
samples : 2 


P(x)  = 


/2n 


exp(-x2/2 o?) 


(A-3) 


The  exact  analytical  expression  for 
quantizing  noise  power  is  known  for  sta¬ 
tionary  Gaussian  signals.  The  quanti¬ 
zing  noisepower,  Nq,  which  is  composed  of 
two  parts,  granular  noise  power,  Ng» 
and  overload  noise  power.  No,  can  be 
computed  as  follows: 


2  i 

3  _2n-i 
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where 
erf  (o^) 
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dx 


Equations  A-4,  A-5,  and  A-6  are 
used  to  compute  Nq/oJ  and  the  signal- 
to-quantizing  noise  ratio 


<s/Vi 


10  log 


10 


for  various  n^-  Figure  A-l  shows  the 
(S/Nq)  ,  values  versus  cu  for  VMious 
n^.  The  optimum  ,  which  maximizes  the 
signal-to-quantizing  noise  ratio  deter¬ 
mined  from  these  curves,  is  given  in 
Table  A-l. 
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For  large  a. ,  equation  (A-4)  yields 
equation  (A-2).  This  term  is  what  is 
generally  known  as  quantising  noise 
because,  when  a  suitable  value  of  a.  is 
used,  the  overload  noise  is  less  than 
the  granular  noise  and  is  therefore  ignored. 
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Table  2.  Optimum  Bit 
Ditrlbution  in  Two-Dimen- 
aional  Walsh-Hadamard  Domain 
(average  four  bite  per 
sample) 


Figure  1.  Two  Dimensional 
Walsh-Hadamard  Basis  for  N>*8. 

Black  areas  represent  +1/N* 
and  white  areas  represent 
-1/N? 
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Table  1.  Optimum  Bit  Distri¬ 
bution  in  Two-Dimensional 
Walsh-lladamard  Domain 
(average  seven  bits  per 
sample) . 


Table  3.  Optimum  Bit  Distri¬ 
bution  in  Two-Dimensional 
Walsh-Hadamard  Domain, 
(average  two  bits  per  sample) 
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Table  A-l.  Optimum  Amplitude 
Loading  Factor  of  the  Quanti¬ 
zer  in  the  Walsh- Hadamard 
Transform  Domain 
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Number  of  Bits  Assigned 
to  the  i-th  Coefficient 


Optimum  Amplitude  Loading 
Factor  for  the  Uniform 
Quantization  of  i-th  Coefficient 


(bits /sample) 


2  3  4  5(7  t 

a. 


Figure  A-l.  Signal-to-Quan- 
tizing  Noise  vs  Amplitude 
Loading  Factor,  a,  for  Vari¬ 
ous  Bit  Assignments 
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SPATIAL  SUBSAMPLING  FOR  THE  TRANSFORM  CODING  OF  IMAGES* 


Clifford  Reader 

University  of  Southern  California 
Department  of  Electrical  Engineering 
Los  Angeles,  California 


Introduction 


The  implementation  of  orthogonal  trans¬ 
formation  over  images  composed  of  a  large 
array  oi  pixels  is  ar.  arduous  task.  Earlier 
work  [l  j  has  showu  that,  if  a  degree  of  error 
may  be  tolerated  then  the  image  may  be 
divided  into  blocks  each  of  which  may  be 
separately  transformed.  Typically  for  an 
image  of  256  x  256  pixels,  blocks  may  be 
selected  of  size  16  x  16  pixels.  The  problem 
which  arises  is  that  for  high  orders  of  redun¬ 
dancy  reduction,  the  edges  the  blocks  and 
the  low  sequency  reconstruction  patterns 
become  visible.  The  object  of  this  study  was 
to  minimize  thjs  spurious  block  pattern  and 
checkering  effect. 

Subsampling  Patterns 

The  desired  effect  of  blurring  the  edges 
of  the  blocks  may  be  attained  by  spatialy 
sub-sampling  the  image  prior  *o  dividing  it 
into  the  blocks.  Preferably  (from  the  stand¬ 
point  of  blurring  the  edges),  this  should  be 
done  in  as  random  a  way  as  possible.  How¬ 
ever,  the  redundancy  reduction  properties  of 
the  transform  derive  from  exploitation  of  the 
inter-element  correlations  and  any  sub¬ 
sampling  scheme  is  bound  to  reduce  the 
correlation  between  samples  in  the  rearranged 
array.  Thus,  there  will  be  a  trade-off 
between  the  reduction  of  image  quality  due  to 
this  effect  and  any  improvement  due  to  the 
elimination  of  discrete  errors.  The  pattern 
chcser  for  evaluation  was  formed  from  a 
Latin  square. 

A  Latin  square  is  an  n  x  n  array  of  the 
integers  1  to  n  such  that  each  integer  appears 
once  and  only  once  in  each  row  and  column 
of  the  array.  The  simplist  non-trivial  example 
is  the  2x2  Latin  square: 


squarec  of  interest. 

(i)  1  2  3  4  (ii)  12  3  4 

2143  4321 

3412  2143 

4321  3412 

Application  of  these  will  of  course  lead  to 
four  images,  but  the  inter-element  correla¬ 
tion  of  each  of  those  images  will  be  much 
reduced.  Ihe  basic  scheme  may  be  modified 
by  selecting  the  elements  in  sub-blocks  of 
m  x  m  elements  (m  =  1,  2,  4,  8).  This  has 
the  advantage  that  the  inter-element  correla¬ 
tion  will  be  high  across  the  sub-block  but 
the  edges  of  these  sub-blocks  will  appear 
just  as  those  of  the  larger  blocks.  An 
investigation  v  ?.s  made  to  determine  the 
statistics  of  the  Latin  squares  and  hence 
choose  those  most  likely  to  be  of  use. 

Latin  Square  Correlation  -  id  covariance 

matrices 

The  assumption  was  made  that  the  image 
may  be  modelled  as  a  first  order  Markov 
process  with  inter-element  correlation: 


C..  =  P  i  4  j  r  integer. 


For  sub-sampling  according  to  a  4  x  4 
Latin  square,  the  row  correlation  matrix 
becomes: 

"  4  8  12  6<J 

1  p  p  p  ---  p 

4,48  : 

P  1  P  P 

8  4,4 

p  p  1  p 


Repeated  over  a  large  array  this  is  equivalent 
to  the  checkerboard  pattern.  Thus  the  image 
could  be  separated  into  two  images  according 
to  the  pattern  and  the  16  x  16  blocks  selected 
from  the  resultant  array.  Two  examples  are 
shown  out  of  the  24  possible  4x4  Latin 


To  model  the  column  correlation  matrix 
a  further  assumption  must  be  made  -  that  the 
correlation  between  elements  of  a  different 
row  and  column  is  the  multiple  of  the  correla¬ 
tions  along  the  rows  and  down  the  columns 
between  the  samples.  For  sub-sampling 
according  to  the  Latin  square: 


♦This  research  was  supported  by  the  Advanced  Research  Projects  Agency  of  the  Defense  and  was 
monitored  by  the  Air  Force  Eastern  Test  Range  under  Contract  No.  FO  8606-72-C-0008 . 
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12  3  4 

2  14  3 

3  4  2  1 

4  3  12 


i 


the  column  correlation  matrices  of  the  samples 
selected  in  the  pattern  of  the  "ones"  is  then; 


",  2  5  5  4  ( 

1  p  p  p  p  p 
P2  1  P3  P3  P4  P4 

pVipV.. 


Software  was  written  to  calculate  these 
matrices,  their  tranf forms  and  hence  the 
variances  of  the  transformed  reordered  sam¬ 
ples.  Estimations  of  mean  squared  error 
made  for  various  zonal  filtering  operations 
on  the  Hadamard  transform  domain  are 
summarized  in  graph  1. 
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Graph  II.  Estimated  mean  squared  error 
for  various  Latin  squares. 

The  Latin  square  number  (i)  is  the  one  with 
least  mean  squared  error,  number  (ii)  the 
one  with  greatest.  This  is  apparent  if 
diagonally  adjacent  elements  are  marked  to 
indicate  high  correlation: 


12  3  4 

(ii)  1 

2  3 

4 

X  X 

X 

2  14  3 

4 

3  2 

1 

X 

3  4  12 

2 

1  4 

3 

X  X 

X 

4  3  2  1 

3 

4  1 

2 

Even  so,  the  difference  in  expected  mean 
squared  error  appears  small  enough  to  leave 
freedom  to  choose  the  Latin  square  most 
suited  to  reordering  the  data. 


Graph  1,  Estimated  mean  squared  error 
versus  sub-block  size. 

As  wculd  be  expected  there  is  little 
difference  between  the  different  Latin  squares 
except  for  small  sub-block  sizes  where  the 
average  inter-element  correlation  begins  to 
decrease.  It  waa  found  that  a  sub-block  size 
of  4  x  4  will  give  a  moderately  worsened 
mean  square  error,  while  for  the  4x4  Latin 
square  offering  a  suitably  random  pattern. 
Graph  II  shows  the  variation  of  estimated 
mean  squared  error  against  the  Latin  square 
patterns  for  a  sub-bloc’.,  size  4x4  and  a  4:1 
sample  reduction. 


Experimental  Results 

Results  were  obtained  for  sub-sampling 
according  to  the  checkerboard  pattern  and  the 
two  Latin  square  patterns  (i)  &  (ii)  for  various 
sub-blocl;  sizes.  The  transform  domains 
were  quantized  by  an  optimised  scheme  to 
give  a  bandwidth  reduction  of  8:1  for  the 
Hadamard  transforms;  12:1  for  the 
Karhunen-  Loeve  transforms.  The  quanti¬ 
zation  -cheme  used  allocated  bits  to  samples 
in  the  transform  domain  according  to  the 
variances  of  those  samples.  Two  bit  alloc¬ 
ation  schemes  are  shown  in  Figure  1  which 
illustrate  the  effect  of  spatial  sub-sampling 
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on  the  statistics  of  the  transform  domain. 

Figure  1.  Bit  allocatior  schemes  for  trans¬ 
form  domain  quantization. 
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(b)  Hadamard  domain,  sub-sampling  with 
Latin  square  (i);  sub-block  size  4x4. 

Sub-sampling  inherently  reduces  sample  corr¬ 
elations  and  leads  to  a  lesser  degree  of  energy 
compaction  around  the  origin  of  the  trans¬ 
form  domain. 

Figure  2  (a)  shows  the  result  of  band¬ 
width  reduction  without  spatial  sub- sampling. 

Figure  2.  Images  processed  without  sub¬ 
sampling. 


(a)  Hadamard  transform;  mean  squared 
erro*  =  0. 161% 


(b)  Karhunen-Loeve  transform;  mean  squared 
error  =  0. 186% 

The  checking  effect  is  pronounced  and  the 
block  edges  are  visible  over  part  of  the 
image  which  was  transformed  with  the 
Karhunen-Loeve  transform.  Figure  3  shows 
the  results  of  checkerboard  sub-sampling 
with  the  Hadamard  transform. 

Figure  3.  Effect  of  checkerboard  sub¬ 
sampling. 


(a)  Hadamard  transform,  sub-block  size 
lxl;  mean  squared  error  =  0.28% 


(b)  Hadamard  transform,  sub-block  size 
8x8;  mean  squared  error  -  0.186%. 
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If  the  cub-block  size  is  1  x  1  •  a  single  pixel- 
then  the  image  is  degraded.  This  ie  due  to 
the  severe  reduction  of  inter-element  correl¬ 
ation  which  the  quantization  scheme  cannot 
accommodate.  However,  for  an  8  x  8  sub¬ 
block  size  the  discrete  checking  effect, 
apparent  in  the  image  which  was  not  sub¬ 
sampled,  has  been  reduced  while  overall 
image  clarity  has  diminished  a  little.  Figure 
3  (c)  shows  the  effect  of  checkerboard  sub¬ 
sampling  with  the  Kar.hunen-Loeve  transform. 


(c)  Karhunen-Loeve  transform,  sub-block 
size  2x2;  mean  squared  error  =  0,  312%. 

It  was  found  that  use  of  8  x  8  sub-blocks 
resulted  in  the  visibility  of  those  blocks  and 
for  a  2  x  2  sub-block  size  the  image  is 
noticeably  degraded.  This  is  a  reflection 
of  the  highly  optimized  nature  of  the  trans¬ 
form;  any  reduction  of  correlation  in  the 
original  image  results  in  a  poorer  quality 
output  image.  The  effect  of  sub-sampling 
with  Latin  squares  is  shown  in  Figure  4. 

Figure  4.  Effect  of  4  x  4  Latin  square  sub- 
sampling  with  the  Hadamard 
transform. 


(a)  Latin  square  (i),  sub-block  size  8x8; 
mean  squared  error  =  0.189% 


(b)  Latin  square  (ii),  sub-block  size  8x8; 
mean  squared  error  s  0. 182%. 


(cl  Latin  square  (ii),  sub-block  r  ,-e  4x4; 

mean  squared  error  =  0. 208% 

Similiar  to  the  results  for  checkerboard  sub¬ 
sampling,  these  results  indicate  the  variation 
in  the  size  of  the  checkering  pattern  for 
different  sub-sampling  patterns. 

Conclusion 

There  ic  a  modest  improvement  in  sub¬ 
jective  image  quality  when  spatial  sub- 
sampling  is  used  iu  conjunction  with  the 
Hadamard  transform  owing  to  minimization 
of  the  checkering  effect.  The  visibility  of 
that  offect  may  be  controlled  by  the  choice 
of  sub-sampling  pattern.  Application  of 
sub-sampling  schemes  to  the  Karhunen-Loeve 
transform  coding  of  images  leads  only  to  a 
reduction  of  image  quality.  Use  of  a  large 
sub-block  size  results  in  visibility  of  those 
sub-blocks  and  use  of  a  small  sub-block  size 
reduces  the  effective  inter-element  correla¬ 
tion  sufficiently  to  impair  the  efficiency  of 
the  transform.  It  is  expected  that  there 
would  be  an  improvement  in  image  quality 
for  the  sub- optimum  Fourier  and  Slant 
transforms. 
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GENERALIZED  SAMPLING  INTERPRETATION  OF  HADAMAILD  AND  HAAR  TRANSFORMS 
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Grumman  Aerosr.-  -  .orporxtion 
Bethpagu,  New  YoiK  11714 


Introduction 

The  use  of  Hadamard  and  Haar  transformations 
in  fcignal  processing  applications  such  as  image  cod¬ 
ing,  [l]  voice  transmission,  [2, 3]  and  data  reduction, 
C4,5]  is  discussed  and  analyzed  in  extant  literature. 
Usually,  in  these  analyses  the  original  signal  is 
assumed  to  have  been  sampled  and  be  in  a  vector 
form  suitable  for  transformation  by  computer  pro¬ 
cessing.  Fast  digital  computers  make  it  conceivable 
to  perform  this  generalized  spectral  analysis  in  real¬ 
time.  However,  additional  insight  into  this  signal 
processing  may  be  obtained  if  the  computer  opera¬ 
tions  are  related  to  more  familiar  concepts  such  as 
frequency  filtering. 

This  paper  relates  linear  transformations  to 
generalized  sampling  [6]  and  shows  that  the  computer 
operations  in  Hadamard  and  Haar  transformations 
haye  an  equivalent  linear  system  interpretation.  The 
transformed  quantities  correspond  to  sample  values 
of  tne  signal  at  the  output  of  linear  filters  that  have 
the  amplitude  and  phase  responses  of  Walsh  filters 
1 7l  A  generalized  sampling  expansion  can  be  found 
that  uses  these  sample  values  in  an  expansion  that 
refers  the  original  signal  to  the  output  of  an  arbi¬ 
trary  linear  filter. 

Generalized  Sampling  Theory  for  Stochastic 
Processes 

It  is  well  kno&n  that  any  bend-limited  function 
can  be  expressed  in  terms  of  its  sample  values  pro¬ 
vided  they  are  taken  at  a  rate  that  exceeds  twice  the 
bandwidth.  Such  a  sampling  expansion  uses  sin  x/x 
basis  functions,  and  converges  in  the  mean-square 
sense  for  band-limited  stochastic  processes. 


The  band-limited  deterministic  signal  is  knowu 
to  have  a  generalized  sampling  expansion[6].  It  may 
use  sample  values  as  well  as  linear  functionals  of  the 
signal;  as  a  result,  the  sampling  interval  can  be  in¬ 
creased.  It  will  be  shown  that  this  expansion  con¬ 
verges  in  the  me  an -square  sense  for  band-limited, 
stationary  stochastic  processes  by  bounding  the  trun¬ 
cation  error.' 


Sampling  Theorem 


let  x(t)  be  a  real,  wide-senoe,  stationary  sto¬ 
chastic  process  with  autocorrelation  function  denoted 
by  the  expectation 


Its  power  density  spectru^i  is  assumed  to  be  band- 
limited  in  the  sense  that;/ 

R(T)**8<»)  =  0  ,  !u>|  >cu0  (2)* 

The  sampling  theorem  allows  an  expansion  of  x  (t) 
using  sin  x/x  basis  functions  if  the  sampling 
interval  T  is  less  than  t/ai  .  This  expansion  con¬ 
verges  [6]  uniformly  in  the  mean-square  sense: 

i  tp  slnw(t-nT)  „ 

lx«-Z,  xWT>  .  A.T)  I  -°  «> 

n  =  -N  0 

A  block  of  N  samples  shall  be  denoted  using 
vector  notation; 

X(t)  =  [  x(t  -(N-l)  T) . X(t  -  T),  xft)!1  (4) 

A  system  for  deriving  this  vector  signal  is  shown  in 
Figure  1.  N  delayed  versions  of  x  (t),  each  sampled 
once  per  NT  seconds,  are  used  to  obtain  the  block 
of  N  samples.  This  sampling  technique  is  usually 
assumed  to  precede  any  transformation  processing. 


lim  E 
N-*  “ 


R(r)  =  E{x(t+  t)  x(t)J 


Fig.  1  System  for  Providing  a  Vector  Signal,  X,  With 
U)  Elements  That  are  Sample  Values  of  the  Process  x  (t) 


*  Fourier  transform  pairs  are  denoted  by  a  double  headed  arrow  (•*— e). 
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Consider  the  systems  of  Figure  2.  The  transfer 
functions  H  <«),  ....  H^i®)  are  defined  for 

|  a  |  <a>Q.  Let  Z(w)  be  the  matrix  of  these  transfer 

functions  with  the  nm  entry  given  by  H  f®  +  (n-l)c], 

m 

where  n,  m  =  1,  .  .  . ,  N  and  c  -  2^/N.  If  Z(o)  is 

non-singular  for  -  <  ®  <-  wQ  +  c,  then  Popoulis[6] 

shows  that  the  response  of  K<u)  to  a  band-limited 
deterministic  signal  x(t),  has  a  generalised  sampl¬ 
ing  expansion  in  terms  of  the  sampled  values  of  the 
responses  of  H, ,  .  .  . ,  H„(® )  to  x(t): 

1  W 

®  N 

«(t  +  r)  =]S£  2rfgi(t  +  n7)  ®hi^r)' 

n  =  -<">  i  =  1  (5) 

?  =  NT  =  Nw/wQ 


Fig.  2  Generalized  Sampling  Equivalent  Systems 

The  basis  functions  used  in  this  expansion  are  deter¬ 
mined  from  H(w),  H^(®),  .  .  and  H^(®).  For 

Z((»)  non-singular,  a  set  of  functions  {{^(w)]  exists 

that  allows  an  expansion  of  the  transfer  function: 

N 

H(oi)  eJait  =  ^  Hj(®)  ),  Ico  |<  ®0  (6) 

i  =  1 

The  Jlj(a) )  are  periodic  in  ®  with  period  c,  and  are 

functions  of  r.  They  can  be  expanded  in  a  Fourier 
series 


L  vT)ei' 


The  coefficients  of  this  expansion,  functions  of  the 
variable  r ,  have  been  shown  to  be  the  set  of  basis 
functions  for  the  generalised  sampling  expansion  (6), 
Their  compulation  is  discussed  In  the  next  section. 
For  stochastic  processes  it  will  be  shown  that  (5) 
holds  in  the  mean-square  sense  by  establishing 
bounds  on  the  truncation  error 


®M(t  +  T)  =  g(t  +  T) 


£  ]£«!<* +nT>*W 


<T)  (8) 


n=-M  i=l 


Let  x(t),  defined  by  (1)  and  (2),  be  the  input  to 
the  systems  of  Figure  2.  With  hj(t)-#— ►  the  re¬ 

sponses  are  stochastic  processes  given  by  the 
convolutions 

g(t)  =  x  (t)  *  h(t)  (9) 

and  ~ 

gj(t)  =  x(t>  *  \{t) ,  i  =  1,  2 . N  (10) 

Formal  substitution  into  (5)  yields  the  output  g(t)  in 
terms  of  the  sampled  values  g.taT)  of  the  responses 
g  (t).  To  show  that  (5)  now  converges  In  the  mean- 
square  sense,  bounds  will  be  established  on  the  trun¬ 
cation  error  (8),  which  1b  now  also  a  stochastic 
process.  Viewing  t  as  a  constant,  eM(t  +  r )  is  in¬ 
terpreted  as  the  output  of  a  linear  system  with  input 
X(t)  and  transfer  function 

M  N 

T(®,  T)  =  H(ai)  )  e^“nT 

n=-M  i=l  (11) 

The  power  spectrum  of  the  truncation  error  is  given 
by  S(® )  |T(® ,  r )  P;  therefore,  the  mean-square 
truncation  error  is  given  by 


f 

E  T^=Z»  j  T)|2d<“ 


Substituting  (6)  into  (11)  yields 

n  r  m 

T(®,  r^Hjf®)  V 

i=i  l  n=-M 


(r)eJ,anT  (13) 


The  term  in  the  bracket  equals  the  error  in  approx¬ 
imating  3j(®)  by  a  truncated  Fourier  series.  If  the 

0|(w)  satisfy  known  conditions,  it  follows  from  the 

theory  of  Fourier  series  that  T(w,  r)  approaches 
,  2 

zero  as  M  -*  •;  hence  lim  E{e^(t  +  r )}  =  0,  M  *. 
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It  follows  that  (5)  bolds  In  the  mean-square  sense  for 
stationary  stochastic  processes. 


Computation  of  the  Reconstruction  Functions 

The  functions  used  for  reconstruction  of  g(t  +  r  ) 
in  (5)  are  the  coefficients  of  the  Fourier  series  for 
0j(<b);  they  are  given  by 


ani(T)  =  c  j  JnTU)  d“  <14> 

A  matrix  formalism  will  be  given  for  the  solution  of 
tho  a^r ).  The  0((u,)  are  determined  by  solving 

the  system  of  equations 


N 

yt  Hjiui  +  kc)  (fjitu)  =  H(®  +  kc)  eJ(<"  +  kC)T  (15) 
i=l 


for  k  =  0,  1,  .  .  . ,  N-l,  and  -  <  a;  <  -  +  c. 

The  matrix  of  transfer  functions  Z(u>)  has  been  de¬ 
fined.  Define  a  diagonal  weighting  matrix,  W (at ), 
the  ii  entry  of  which  is  given  by  the  filter  transfer 
function,  H(u>),  evaluated  for  -  o>  +  (i-1)  c  <  w  £ 


wj}  =  H(u>  +  (i  -  1)  c)  (16) 

All  off-diagonal  terms  are  ;ero. 

Define  column  vectors  of  0^(<n)  and  exponentials  by 


*(«>)= 


»] 


(IV) 


and 


bit,  -  n,  J" ....  .“"-''"i* 


Then  (15)  can  be  solved  in  matrix  form  for  f*j(®): 


$(®)  =  T 


-1 

z(®)W(®)  B(r) 


(18) 


Exp(j®T)  is  a  common  factor  to  each  0^®).  In 

addition,  exp(jkcr)  =  exp  (kc(r  -  nT)),  because 
kcnT  =  2  kntr ;  as  a  result,  a^r)  =  aQi(T  -  nT). 

Let  the  column  vector  of  &flJT)  be  defined  by 

Aq(t)  =  <a01(T>,  ....  A^r))1,  then 


-u,  +c 


V 


J  *“■ 


(®)W(«)ej<”Td®B(T),  (19) 


and  the  vector  of  ftnj(T)  is  given  t»y 


An(T)  =  A0<T'nX) 


(20) 


The  generalised  sampling  expansion  (5)  can  be  writ¬ 
ten  as: 


o>  n 

g(t+  r)  =  EE  aQi(r  -nT)^(t+nf)  (21) 

n=-»  i=l 


Comment 


The  importance  of  generalized  sampling  theory 
lies  in  the  simplicity  of  reconstruction,  i.e. ,  that  a 
set  of  functions  (a^r)}  can  be  found  that  allows  a 
sampling  expansion  which  uses  sample  values  that  are 
linear  functionals  of  the  original  process.  For  H(u>)  = 
1  the  reconstructed  process  is  the  original  process, 
X(t).  If  the  samples  g^nT)  are  quantized,  introducing 

quantization  error  q^nT)  into  each  sample  used  to 
construct  the  estimate  of  x(t),  then  the  quantization 
error  in  the  generalized  sampling  expansion  takes  the 
form  (21) 


co  n 

v +  t> = E  Ev- nx>  + nx>  *22> 

n=-'°  i=l 

The  aoi(V)  are  obtained  from  (19)  with  W(oj)  the 
identify  matrix. 

hi  some  cases,  a  more  meaningful  measure  of 
error  results  if  (22)  is  weighted,  f.  e. ,  observed  at 
the  output  of  a  linear  filter  with  impulse  response 
h(t)«~*H(®)  (Note  H(u) )  i3  now  i  ot  necessarily  1,  as 
above).  The  weighted  error  is  then  given  by  the  con¬ 
volution  e  (t  +  T)  *  h(r).  This  is  equivalent  to  having 

~q 

used  the  generalized  sampling  expansion  to  construct 
h(t)  *  x  (t),  rather  than  x  (t),  with  the  samples 
g,(nT).  The  functions  a_.(r)  now  obtained  from  (19) 

'■w'l  01 

will  include  the  weighting  of  the  diagonal  matrix 
W(®),  whose  entries  are  obtained  from  H(®).  If 
he  samples  are  quantized,  the  generalized  sampl¬ 
ing  expansion  for  the  error  again  takes  the  form 
(22);  however,  this  expression  now  refers  the  quan¬ 
tization  error  to  the  output  of  the  weighting  filter. 

Generalized  Sampling  Interpretation 
of  Linear  Transformations 

Linear  transformation  of  blocks  of  samples  (4) 
has  an  equivalent  linear  system  and  generalized 
sampling  interpretation.  That  equivalence  Is  pre¬ 
sented  and  applied  to  Hadomard  and  Haar  trans¬ 
formations. 

Linear  Transformation  of  Blocks  of  Samples 


Let  the  block  of  N  samples  (4)  of  the  process  x(t) 
be  transformed  by  the  N  x  N  matrix  II  yielding  the 
vector 

Y  =  HX 


The  elements  of  Y  are  given  by 


(23) 


N 

ik=2  bkl  X<lT)  <24) 

i=l 

where  k  2  1,  2 . N,  and  h,  .,  are  the  elements 

of  H.  Equation  (24)  has  the  following  interesting 
interpretation.  If 

N 

&(t)  =2  \l  X(t  ‘  NT+  1T>  (25> 

i=l 

then 

Yk  =4  (NT)  (26) 

That  is,  y^  is  the  sample  value,  taken  every  NT 

seconds,  of  the  response  to  x  (t)  of  the  filter  with 
transfer  function 


A  block  diagram  for  this  interpretation  is  shown  in 
Figure  3.  Each  transfer  function  is  the  sum  of 
weighted  delays  of  x  (t),  and  obviously  has  the  period 


2u>0;  however,  since  x(t)  is  band  limited,  each  H^(iu) 


may  be  truncated  for  |  o>  [  > 


Fig.  3  Generalized  Sampling  Equivalent  to  the 
Linear  Trans  formation  Y*>HX 


Use  system  of  Figure  3  represents  a  generalized 
sampling  system  if  the  matrix  of  transfer  functions, 
Z(tu ),  is  non-singular.  To  show  that  R  alone  deter¬ 
mines  this  condition,  consider  the  matrix  E(w) 
defined  as  having  for  its  nm  entry 

e  =  exp(-j(<#  +  (n-1)  c)(N-m)T)  (28) 

nm 

where  n,  m  =  1,  2,  .  .  .  N.  This  is  the  matrix  of 
transfer  functions  that  corresponds  to  conventional 
block  sampling  (Figure  1).  L  can  be  shown  that  the 
matrix  E(w)X/ft  is  unitary;  hence,  the  determinant 
of  E(w)  cannot  vanish.  The  inverse  of  E (<o)  is  given 
by  (1/N)  E*(tu)  (the  asterisk  signifies  matrix  adjoint). 

From  (27)  and  (28),  it  can  be  seen  that  the 
matrix  of  transfer  functions  Z(ro )  is  given  by  the 
matrix  product 

Z(a>)  =  E(tu)  H*  (29) 

Its  determinant  is  the  product  of  the  determinants  of 
E(u> )  and  H.  The  determinate  of  E(u> )  cannot  vanish; 
therefore,  the  non-singularity  of  Z(<u )  is  determined 
by  H.  K  H  is  non-singular,  a  set  of  N  functions 
a01(T)  can  be  found  that  allows  a  sampling  expansion 

(21)  using  the  transformed  samples  y^. 

The  functions  used  in  the  generalized  sampling 
expansion  (21)  can  be  determined  from  (19)  and  (29): 


A0(T)  =  N ic^J  E*»  w<“>>  eJ“'  Tdw  B<T> 

"—a,  (30) 

0 

W(u> )  (see  (16))  is  independent  of  the  transformation 
H  and  of  the  Hj(o>);  it  represents  a  filtering  or 

weighting  applied  to  the  signal.  As  a  result,  the 
generalized  sampling  expansion  (21)  is  the  sampled 
process  referred  to  weighting  filter  output  as  dis¬ 
cussed  in  the  previous  section,  if  the  samples  are 
quantized  the  weighted  quantization  error  can  be 
obtained  from  the  sampling  expansion  directly. 

Application  to  Hadamard  Transform 

When  the  transformation  in  (23)  ie  a  H&damard 
matrix,  normalized  so  that  each  entry  is  +  lX^N,  the 
filter  responses  of  (27)  are  those  of  Walsh  :ilters[?]. 
The  transfer  functions  for  N  =  2,  4,  and  8,  are  given 
in  Table  1  and  sketched  in  Figures  4,  5,  and  6. 

Figure  4  shows  that  processing  with  N  =  2  is  equiva¬ 
lent  to  low-  and  high-pass  filtering  of  x(t).  The  filter 
responses  for  N  =  4  are  sketched  in  Figure  5.  In 
addition  to  low-  and  high-pass  filtering,  there  is  now 
also  some  band-pass  filtering.  For  N  =  8,  the  filter 
responses  are  shown  in  Figure  6. 

Comprrison  of  Figures  4,  5,  and  6  shows  how  the 
band-pass  characteristics  of  each  equivalent  filter 
changes  as  the  block  sample  size  in  tho  processing  is 
increased.  Each  transformed  variable  still  derives 
its  energy  from  the  total  signal  spectrum;  however, 
there  appears  to  be  increasing  frequency  selection. 

As  a  result,  sequency  filtering,  i.e.,  setting  y;  =  0, 


sin  o>0(t-2nT) 

1  h 

a.0(t-2nT) 

sin  i^(t-(2n-l) 

<i>0(t-(2n-l)  T 

n~-® 


* ,  (2nT)  sin  a>A<t-(2n-l)  T)  sin  u>  A(t-  2nT) 

u  u 

"~/T~  u>.(t-(2n-l)  T)  ‘  a;  .(t-2nT) 

S  0  Jj 

which  can  be  shown  to  be  identical  to  the  sampling 
expansion.  Thus:  a  new  set  of  basis  fractions  has 
been  found  mat  consists  of  linear  combinations  of 
the  original  sin  y/x  basis. 

Application  to  Haar  Transform 

An  orthogonal  sequence  of  functions,  defined  by 
Haar  in  1909  is  given  by: 

xJV>=  1 

j  SSL  <es!^ 

,%)J_2n/2kiZ2<^k/2a 

n  )  2 


For  n  =  2,  tho  Haar  matrix  is  given  by 


1111 

1111 

/ 2  /2  -/  2  ~/'2 

C  0  0  0 


1111 
-1  -1  -1  -1 

0  0  0  0 

/2  /2  -/2  -</2 

0  0  0  0 


These  transfer  functions  are  again  obtained  using 
previous  equations.  The  first  two  are  the  same  as 
for  Hadamard  transform  of  order  8,  sequency  0  and  1 
respectively. 

H^fou )  =  2/2  cos  (bT/2  cos  iuT  cos  2u>  T  e  ^7a>T^2^ 

H2(cu)  =  2/2  cos  iuT/2  cos  wT  sin  2u>T  e'j<7tuT/2+ w/2) 

These  transfer  functions  are  shown  in  Figures  6  and 
7.  Hie  next  two  transfer  functions  are  obtained 
from  Hadamard  of  order  4,  but  with  0  and  T  both 
increased  by  a  i_ctor  of  2  and  each  suitably  delayed: 


0  aU  other  0  in  [0,  1], 


H  (a))  =  2  cos  u/T/2  sin  u/T  e 

O 

H4(u> )  =  2  cos  wT/2  sin  a<T  e 


-J(llu)T/2  +  ff/2) 
-j(3u)T/2  +  ff/2) 


for  0  s  0  <  1,  n  2  0  and  1  *  k  s  2n.  These  functions 
are  discussed  by  Nagy  [8]  and  Andrews  [9],  The  dis¬ 
crete  Haar  functions  are  obtained  by  sampling  con¬ 
tinuous  Haar  functions  and  are  used  to  write  the  Haar 
matrix.  The  Haar  matrix  for  n  =  0  is  the  Hadamard 
matrix  of  order  2.  Its  equivalent  filter  transfer 
functions  are  listed  in  Table  I  (under  N  =  2)  and  shown 
in  Figure  4. 

For  n  =  1  the  Haar  matrix  is 


The  equivalent  filter  transfer  functions  are  obtained 
using  results  for  Hadamard  filters  of  order  4  and  2. 
The  first  two  filters  (sequence  of  0  and  1)  are  the 
same  as  those  for  Hadamard  transform  of  order  4. 
The  remaining  filters  correspond  to  the  high-pass 
filter  (suitably  delayed)  of  the  N  =  2  Hadamard  trans¬ 
form.  The  transfer  functions  are: 


H^U) )  =  2  cos  u>T/2  cos  w  T  3~^  3W 
H2(a»  =  2cos  oT/2  sin  <bT  e'^2  +  ff/2> 
H3(io  )  *  /2  Sin  ojT/2  e'S<5u)T/2  T  n  /2) 

H4(w) /2  sin  ii)T/2  e'j '“T//2  +  * ,Z) 


These  transfer  functions  are  shown  in  Figure  5. 

The  last  four  transfer  functions  (m  =  5,  6,  7,  8)  are 
obtained  from  Hadamard  of  order  2: 

H  (u> )  =  /2  sin  <oT/2  e"j(<“T/2  +  2(8-m>  “  T  +  */2> 
m 

These  transfer  functions  are  shown  in  Figure  4. 
Figure  7  shows  all  the  equivalent  Haar  filter  fre¬ 
quency  responses  for  n  =  2  and  N  =  8.  There  is 
considerable  overlapping  of  the  filter  pass-bands. 

The  Haar  matrix  as  defined  above  has  the  prop¬ 
erty  F  F*  =  ML.,  where  N  =  2^n  +  For  the 
J  n  n  N 

special  case  of  no  weighting,  W(tu)  =  1,  the  basis 

N 

functions  for  the  generalized  sampling  expansion  (21) 
are  given  by 

A 0(T)  -  5  F*  [rin  w0(r  +  (N-l)  T)/»0(r  +  (N-l)  T) . 

sin  “0r/u’0Tjt  • 

Conclusions 

The  generalized  sampling  expansion  ,vas  shown 
to  converge  in  the  mean-square  sense,  ft  was  shown 
that  linear  transformation  of  blocks  of  sampled  data 
has  an  equivalent  linear  system  and  generalized 
sampling  interpretation.  If  the  transformed  samples 
are  quantized,  the  generalised  sampling  expansion 


Fig.  7  Haar  Filter  Frequency  Response  for  n=2  and  N=8 


ear.  be  used  to  describe  the  weighted  quantization 
error  in  the  reconstructed  process.  For  Hada- 
mard  and  Haar  transforms  it  was  shown  that  the 
equivalent  generalized  sampling  filter  transfer  func¬ 
tions  are  those  of  the  Walsh  filters. 
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TABLE  1  HADAMARD  FILTER  TRANSFER  FUNCTIONS 


Sequency 

N  =  2 

N  =  4 

N  =  8 

0 

/ 2  cos  (o  T/2 

8(co)  =  -u)  T/2 

2  cos  to  T/2  cos  ib  T 

0f((o)  =  -3(o  T/2 

2/2  cos  toT/2  cos  uiT  cos  2(bT 

(t(w)  =  -7  (oT/2 

1 

/2  sin  to  T/2 

0((o  )  -  -((o  T/2  +  rr/2) 

2  cos  ib  T/2  sin  ioT 

0(ui)  =  -3w  T/2  -  7T/2 

2/2  cos  u/T/2  cos  u>T  sin  2u/T 

0(io)  =  -7u)T/2  -  n/2 

2 

2  sin  ooT/2  sin  to  T 

0(w)  =  -3<b  T/2  -  rr 

2/  2  cos  wT/2  sin  (o  T  sin  2(0  T 

0(u>)  =  -7  <b  T/2  +  ir 

3 

2  sin  U)  T/2  cos  coT 

0((o )  =  -3<o  T/2  -  it  /2 

2/2  cos  aiT/2  sin  ibT  cos  2(b  T 

0(ib)  =  -7  u/T/2  -  jt/2 

4 

2/2  sin  u)T/2  sin  mT  cos  2ibT 

0((o)  =  -7(o  T/2  +  rr 

5 

2/2  sin  u/T/2  sin  00T  sin  2(oT 

0((o)  =  -7  cbT/2  +  rr/2 

6 

2/2  sin  (oT/2  cos  tuT  sin  2ooT 

0(uj)  =  -7ioT/2  +  rr 

7 

2/ 2  sin  u/T/2  cos  coT  cos  2<o  T 

0(u> )  =  -7(0  T/2  +  rr/2 
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ABSTRACT 

This  paper  deals  with  the  derivation  of 
the  sampling  principle  using  the  Walsh  analysis 
techniques.  A  result  analogous  Lo  that  using 
Fourier  analysis  is  the  consequence.  Fitst  a 
generalization  of  Walsh  functions  and  transforms 
along  with  a  summary  of  their  useful  properties 
is  presented.  Then  a  definition  of  a  delta 
function  to  suit  the  Walsh  analysis  is  estab¬ 
lished.  Final!/,  the  derivation  of  the  sampling 
principle  utilizing  Walsh  functions  is  treated. 

I.  GENERALIZED  WALSH  FUNCTIONS 

Assume  that  the  non-negative  real  numbers 
x  and  z  have  the  dyadic  representations: 


x  "  l  2  x,, 

i— 11 


1  *  z  (1) 

i— N 


where  xi  and  z  e{0,l}. 

Define  the  addition©and  multiplier  rion  © 
operations  respectively  by: 


u»x©z“  l  2  u , , 
i-N 


0,  if  Xj  +  is  even 
1,  if  +  z^  is  odd 


w  *  x®z  «  l 


0,  if  £  x  z,  is  even 
Khj=i  K  J 

1,  if  l  x  zA  is  oc.i 

t/j.  J  _  1  J 


The  notation  £  denotes  a  sum  ovet  all  pos- 
K+j»i 

sib'  K  and  j.  K.  -  -N.-N+l,...;  J  »  -  N.-N+l,... 
such  that  the  condition  K+)“i  is  fulfilled. 
Utilizing  definitions  (2)  and  (3),  the  general¬ 
ized  Walsh  functions  are  defined  ss: 

ip(z,x)  «  ij/(l,x®z),  for  all  z  >  0  (s) 

where  ip(  ,x)  denotes  the  first  Walsh  function. 

Geneva'1  lzeu  Transform:  A  generalized  Walsi 
ttansform  is  defined  vich  the  aid  of  the  £.  i.c- 
tions  iji(z,x)  for  <*  function  f(x)  (f(x)  is 
assumed  to  be  sauare-integtable)  as: 


W[f(x)]  «  F(z)  -  f(x)  tKz.x)  dx 


And  the  inverse  transform  is  subsequently  given 
by: 

00 

W_1[F(z))  -  f  (x)  “  f  F(z)  </(z,x)  dz  (6) 


The  parameter  z  is  usually  referred  to  as 
6equency  and  has  units  of  zeros  per  second  (zps) 
as  it  denotes  the  average  number  of  zero  cros¬ 
sings  of  the  function  ij/(z,x)  in  a  unit  interval. 

Properties  of  the  Transform:  Some  useful  prop¬ 
erties  of  the  Walsh  functions  and  transforms 
are  stated  briefly: 

(1).  Orthonormality  Principle:  the  Walsh 
functions  :J)(:i,x)  form  a  complete 
orthonormal  set  with  the  property: 


|  "'Kn,: 


)  lHs,x)  dx 


|  iHn©s,> 


6  (KronecFer’s  delta) 
ns 


f 1,  if  n  -  s 

(7) 

^  0,  if  n  s 

The  parameters  n  and  3  sre  integers. 

(2).  Parstval's  Theorem:  for  two  arbi¬ 
trary  functions  f(x)  and  g(x),  the 
following  relation  holds: 


f(x)  g(x)  dx  -  i  F(z)  G(z)  dz 


•.iisre  F'(z)  ■>  W{£(x)],  and  G(z)  « 

(3).  £>i..:tlng  Theorem:  if  £(x>  ie  Walsh- 
transformed  into  F(z),  then  the 
dvadtcnlly-t ran slated  function 
f(xC5>a)  is  transformed  as: 

Wi  f  (x  ©  a))  "  vjf(  z.e)  ?(*>.  (9) 

(A).  Convolution  The' rem:  if  £(x)  and 

g(x)  ar t  dysdicfllly-cocvolycd,  i.e. 


L, 


h(x)  -  f(x)®g(x) 

(10) 

00 

[ 

or 

03 

f  (t)  6(t  ©a)  dt 

J 

0 

h(x)  »  [  f(t)  g(t©x)  dt 

(ID 

CO  00 

/  r 

J 

0 

-  j  f  (t)  [  I  <|i(t,x)  'i'(a.x)  dx) 

where  the  operator ®  denotes  dyadic 
convolution  and  is  defined  by  (11); 
then 


H(z;  -  F(z)  G(z) 


(12) 


(5).  Symmetry:  from  the  definition  of 

the  functions  y(z,x)  it  follows  that 
the  functions  iJj(z,x)  are  symmetric 
in  the  sense  that  the  parameters  z 
and  x  are  completely  interchangeable 
in  any  relation  involving  Walsh  func¬ 
tions  or  transforms,  i.e. 


t|/(z,x)  “  <Mx,z) 
II.  DEL'"\  FUNCTION 


(13) 


A  delta  function  is  now  defined  for  Walsh 
functions  as: 


6(z)  -  |  W(z.x)  dx 
0 


(14) 


i.e.  the  following  transform  pairs  are  obtained 

f (x)  -  1  -w  6(z)  (15a) 

F(z)  -  1  -*■  6(x)  '  (15b) 

where  the  two-edged  arrow  denotes  a  compatible 
transform  pair. 

The  delta  function  as  defined  by  (14)  is 
easily  extended  to  the  general  case  of  o(z©k) 
by  rewriting  (14)  as: 

00 

6(z©k)  »  j  ifi(z©k,  x)  dx 
0 


<!>(.:  ,x)  i}*(k,x)  dx 


(16) 


The  sampling  property  of  this  function  is 
,  iven  in  the  following  theorem. 


then 


T^eprem  I:  If  f(t)  is  continuous  at  a, 


0  0 

Interchanging  the  order  of  integration 
(i.e.  integrating  w.r.  to  t  first)  gives 


CO  (  00 


|  iha,x)[|  £ ( 
0  0 
CO 

*  |  <Ka, 


(t)  ij>(t,x)  dt)  dx 


,x)  F(x)  dx  ”  £{ a)  (l7b) 

From  the  theorem  it  is  easily  seen  that 

(18) 


|  6(i©a)  dt  =  1 
0 


Relations  (17)  and  (18)  ascribe  an  inter¬ 
pretation  to  the  delta  function  as  it  is  used 
an  Fourier  analysis. 

III.  SAMPLING  PRINCIPLE. 

haorem  II:  Assume  that  fft)  is  a  se¬ 
quent  v  bandlimited  signal,  with  bandwidth  2B  zps 
in  the  sequency  domain.  If  f(t)  is  sampled  at 
intervals  of  1/2B  sec.,  then  it  is  possible  to 
reconstruct  f(t)  from  the  knowledge  of  these 
sa.npl  es . 

Proof:  With  f(t)  restricted  as  in  the 
theorem,  the  following  constraint  is  obtained 

F(k)  -  0,  for  all  K.  <  0  and  K  >  2B  (19) 

And  F(k)  can  be  extended  to  yield  a  periodic 
function  of  period  2B.  This  periodic  function 
can  subsequently  be  expanded  in  a  W3lsh  series 
as : 

CO 

F(k)  =  l  A(n)  iMn.k),  0  <  k  <  2B  (20) 
n=0 

where  the  expansion  coefficients  A(n)  are  eval¬ 
uated  by, 

2B 


A(n)  -  25  |  F(k)  l(.(n,k)  «.x  (21) 


fft)  6(t©a)  dt  -  f(s) 


(17) 


Ptcof:  Let  f(t)  ana  F(z)  be  a  Walsh  trans¬ 
form  pair.  From  (16)  the  left-hand  side  of  (17) 
can  be  written  as 


Now, 


2B 

f(x)  -  f  F (k)  >J)(k,x)  dk 

J 

0 


(22) 


Using  the  symmetric  property  of  Walsh  fur 
tions,  i.e. 


^  r  zz  *;  v 


•  - l.-M 


t(k,x)  =  i(i(x,k) 


gives 


2B 

f(x)  -  |  F (k)  iKx.k)  dk  <23) 


Evaluating  f(x)  at  the  sampling  instants 


xr  *  n/2B  yields 


2B 


f(xn)  «  f( 


(it>  "S 


F(k)  lp(^,k)  dk  (24) 


f(x  )  -  2B  A(n/2B) 
n 


(25) 


Th-  ,  it  is  concluded  from  (25)  that  the  expan- 
i  ■  coefficients  A(n)  can  be  derived  from  the 
values  of  f(ss)  at  the  sampling  instants  x  ■  0, 
1/25,  2/2B,  3/2B, . . .  And,  F(k)  can  be  deter¬ 
mined  uniquely  by  the  values  of  the  sampled 
ordinates  as  follows: 


F(k)  =  l  A(n)  ij)(n,k),  0  <  K  <  2B  (26a) 
na0 


F(k)  '  I  jj  f^)  <Kn,k)  (26b) 

n=0 


Hence,  knowledge  of  F(k)  enables  the  determina¬ 
tion  of  f(x)  for  all  possible  x,  i.e. 


2B 

f(x)  =  |  F(k;  i*i (k,x)  dk 


(27a) 


2B 


f(x) 


fen 

15  '  l 

„  n=0 


f (■jg)  ^(n,k)3  <|<(k,x)  dk 


(27b) 


Interchanging  the  order  of  integration  and  sum¬ 
mation  i.i  (27b)  gives 


2t> 


1  V  r  /  h\  f 


f(x)  -  ~  l  f(-r£)  i  <>(n,k)  Mk.x)  dk 

n"°  0  (28) 


Let  the  integral  in  (28)  be  designated  as: 
2B 

I(m,B)  ■=  |  iji(n,k)  <ji(k,x)  dk,  m  ■  n@x. 


(29) 


Using  the  symmetric  property  of  Walsh  functions 
as. 


iKk,x)  *  >Kx,k) 


<y>) 


yields 


2B  2B 

I(m,E)  -  |  ^(-.,k)  i!)(x,k)  dk  -  |  ij)(m,k)  dk, 
C  0 


(31) 


Fine  discussed  a  similar  integral  defined  as 


J(m,x)  -  i|i(m,t)  dt,  m-0,1,2,... 
J0  (32a) 


ty 


The  result  for  a  general  index  m  is  given 


J(ra,x)  ■  2  ^n+2^[i|»(m',x) 


-  I  2"r  ij*(2n+T  +  a.x)] 
r-1 


(32b) 


where  f  r  m  >_  1,  m  can  be  written  as  ■  •  2 
+  m ' ,  a  -d  0  <  m '  <  2n . 


Define  the  integral 


D(k,B)=  fB<&(k,x)dx  k  is  real,  (33) 
0 


Using  the  definition  of  generalized  Walsh 
functions  as 


lb  (k,x)  =  t!i  (kQ,x)  ib  (xQ,k) 


(34) 


wnere  k.  and  x.  denote  the  greatest  integers 
in  k  andx  respectively. 


Thus , 


,-B 


D(k  , B)  =  I  0  (k.  ,x)  :Mxn,kidx  (35) 
v  0  0  u 


Two  cases  concerning  (35)  are  analyzed  sep¬ 
arately  . 

1)  5  <1.0  . 

This  yields 


.B 


D (k , B)  =  j*  ib  (k  ,x)dx 


(36) 


J0  '"O' 

which  in  terms  of  Fine's  integral  Is  evaluated 
as 

(37) 


D(k  ,  B)  =  I  (3) 

0 


2)  B  > 1.0  ■ 


In  this  care  the  result  of  (35)  Is  simplified 
y  dividing  the  (0 ,  B)  interval  Into  Integral  sub- 
'te'wals  of  unit  length. 


Hence,  in  the  (p,p+l)  subinterval 


:<0  =  P  ,  p  s  x  <  p+1 


(33) 


Thus 


B0-l 


.P+* 


D(k,B)  =  I  <5(p,k)  J  ib  (k_  ,x)dx 
p=0  P 


+  $  (Bq  ,k')(  J  b  (kj.  ,x)dx]  (39) 
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The  last  Integra)  In  (39)  covers  the  end  sub- 
interval  which  might  differ  from  unit  length. 

And  so  In  terms  of  Fine's  J-functlon,  (39)  sim¬ 
plifies  to 

Bo-1 

D(k,B)=£  t(i  (p,k)[J.  (p+D-J.  'p)l 

p=0  K0  0 

+0(B„,k)rj  (8)  -  J  (B_)l  .  (40) 

J  kg  ko  u 

Returning  tc  the  original  Integral  In  (33), 

I(m,b)=  tii  |m,k)dk,  min  real,  (41) 
J0 

Hence 

I(m,b)  -  D(m,2B)  (42) 

And  (28)  .educes  to 

f(x)~2-y  |0  f(23)D(m,2B),  m  =  n©x-  <4'> 

Eq.  (43)  clearly  Indicates  that  the  function  f(x) 
can  be  constructed  from  Its  sample  values  at 

x  =~r  ,  whicn  Is  the  conclusion  of  tne  samp- 
n  L  B 

ling  principle. 

IV.  CONCLUSION 

The  desired  result  of  sampling  principle 
is  manifested  in  (43).  This  result  formulates 
the  principle  In  the  n-domain,  and  a  .  it respond¬ 
ing  result  can  be  obtained  in  the  sequency  (z-) 
domain  by  following  analogous  steps  of  deriva¬ 
tion. 

The  derivation  of  (43)  for  Walsh  analysis 
is  seen  to  parallel  the  derivation  of  sampling 
principle  In  the  cla-sic-al  Fourier  analysis. 
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Introduction 

The  problem  of  sampling  expansion  in 
the  case  of  continuous  functions  has  been 
studied  recently  { 1 | .  But  digital  trans¬ 
mission,  h.ign  speed  digital  computer 
image  processing  and  pattern  recognition 
techniques  deal  with  large  3ets  of  finite 
and  discrete  signals  '  ’tead  of  classical 
continuous  and  inf ini  unctions.  There¬ 

fore,  it  is  desirable  lo  review  the  above 
problem  in  the  case  of  discrete  and 
finite  functions. 

Section  II  studies  some  properties  of 
truncated  Walsh-Fourier  (WF)  finite  se¬ 
ries.  Characteristics  of  partial  sums  and 
their  transforms  are  pointed  out.  Ortho¬ 
gonality  of  WF  kernel  is  proved.  Inter¬ 
pretation  of  dyadic  derivative  is  given 
in  terms  of  Ffijer  sum.  In  Section  III, 
the  concepts  of  "M-sequency  band-limited* 
signal,  (M3L)  ,  and  "M-sequency  bar.d-pass" 
signal,  (MBP)  are  introduced.  From  these 
concepts,  sampling  expansion  theorems  are 
shown.  It  is  proved  that  a  MBL  or  a  MEP 
signal  can  be  recovered  only  by  M  =  2m 
of  their  values,  properly  chosen.  In 
Section  IV,  various  bounds • involving  the 
MBL  signals  are  estimated  using  the 
technique  based  on  maximum  response  of 
linear  dyadic  system. 


Definitions  and  Notations 


The  functions  to  be  considered  in  this 
paper  are  defined  on  a  domain  B_,  the  set 
of  non  negative  integers  less  tnan  N  «  2n, 
where  n  in  turn  ie  a  positive  integer. 
Each  element  x  of  Bn  has  a  unique  expan¬ 
sion 


x 


n~l 

Z 

r=0 


V 


CD 


with  n  coefficients  in  {0,li. 


The  discrete  Walsh-Kaczmarz  functions 
cf  order  n  are  defined  as  in  j  2  j 


wal (u,x) 


n-1 

exp  rri  t^Vr^-r-l’V121 


where  the  operators  <J>  and  I  denote  dyadic 
addition,  and  u  ■  0.  The  variable  u  is 
used  for  denoting  the  number  of  zero 
crossings  in  the  range  0  £  x  <  N.  The 
sequency  of  wal(u,x>  may  be  defined  as 
integer  part  of  the  half  cf  u+1  1 2  ( ,  but 
in  the  paper  the  term  sequency  is  used 
instead  of  zero-crossing,  if  no  otherwise 
specified. 


The  set  {<k(k,x)}  where 
n-1 

<Mk,x)  *  exp  iti  I  k_x_  (3) 

r*0  r  r 

is  called  the  discrete  Walsh-Paley  func¬ 
tions  | 2 | ,  and  is  identical  with  the 
rows  in  the  natural  ordering  of  the 
Hadamard  matrix.  The  one-to-one  corres- 
j  ondence  between  u  and  k  such  that 
ial(u,x)  *  <jt(k,x)  has  been  given  in  |3|. 

The  WF  transform  of  a  function  f(x) 
and  its  inverse  transform  are  defined 
respectively  as  follows: 

,  N-1 

F(u)  »  N  Z  f (x)  wai(u,x),  (*) 

x=0 

N-1 

f(x)  =  Z  F  (u)  wal  (u,x) ,  (5) 

u=G 

Truncated  Walsh  Finite  Series 
and  frg-fer  Sum 

Truncated  Walsh  Finite  Series 
Let  define  the  partial  sum 
«  P-1 

f  (x)  *  Z  F (u)  wal(u,x).  (G) 

P  u=0 

Substituting  Eq.4  into  Eq.6,  and  in¬ 
verting  the  summation  order  lead  to 

.  N-1  p-1 

f.  (x)  *  Z  Z  wal  (u,  j©x)  f  (j) .  (7) 

*  j=0  uc0 

Let  the  WF  kernel  be 

p-1 

d  (x>  =  Z  wal(u,x).  (8) 

p  u«0 

Substituting  Eq.8  into  Ea.7 
-1  N~1 

f  'x)  *  N  1  Z  d  (x«j)  f(j) 

P  j=0  P 

=  dp(x)  •  f (x)  (9) 

where  •  denotes  the  logical  convolution. 
£q  9  proves  that  (x)  is  ''•he  weighted 
average  of  fix)  with  the  '  mel  as 
weighting  function. 

Consider  now  the  case  *i-.ere  p»M“2m  . 
It  is  easy  to  verify  that 


23d  - 


<rr;  .  , 


R-l 

!(*)  =  M  r  S(x  *  r) 

**  r=0 

where  R  =  NM-1 

and  the  discrete  delta  function  | 3 | 


6  (x)  =  5 


x,0* 


(10) 
(10. a) 
(10. b) 


The  right  handside  of  Eq.  lC.b  is  the 
Kronecker  notation.  Using  Eq.9  and  Eq.10, 
a  simple  manipulation  gives 

R-l 

(ID 


?M (x)  =  R-1  Z  f(x  *  r). 

M  r=0 

Now  let 

x  =  pR«s  (12) 

where  p=0,l,..,M-l  and  s»0,l,..,R-l  . 

Using  Eq.12,  Eq.ll  can  be  rearranged  as 
follows 


,-l 


M-l  R-l  R-l 


f  (X)=RJ‘  Z  Z  Z  { f(pR©s  «r) 

p=0  s=0  r=0  6(x©pR©s)}. 

Applying  tne  invariance  lemma  1 2  j  ,  r.he 
last  expression  becomes 

M-l  ,  R-l 

fM(x)  =  Z  {[R_1  Z  f(pR  ft  r)] 

M  p=0  r=0 

P.-l 

Z  6  (x  $  pR  ©8)  )  .  (13) 

s=0 

Investigating  Eq.13  shows  that  f„(x)  is 
composed  of  M  trains  of  impulses”  each 
of  these  trains  is  formed  by  R  impulses 
of  which  the  amplitudes  are  equal  to  the 
mean  of  -R  corresponding  values  of  the 
original  signal  f(x). 


It  is  easy  to  verify  that  the  trans¬ 
can 

M-l 


form  of  f„(x)  can  be  obtained  as 

fj 


F„(u)  «  F(u)  Z  6(u  ®  j).  (14) 

M  j-0 

From  Eq.13  and  Eq.14  it  is  seen  that: 

V  Statement  1 

a.  The  set  of  M  mutually  exclusive  and 
exhautive  subsums 


.-1 


R-l 


R  Z  f (pR  ®  r) ;  p  =  0,1,.  .  ,M-1 
r=0 

and  the  set  of  M  first  components 

F (u)  ;  u  =  0,1,.., M-l 

form  a  M-Walsh- Fourier  transforms  pair. 

b.  By  duality,  the  set  of  M  mutually 
exclusive  and  exhautive  subsums 

R-l 

R  -  Z  F (pR  ©  r)  ;  p  =  0,1,.., M-l 
r=0 

and  the  set  of  M  first  values 
f (x)  ;  x  =  0,1, . . ,M-1 

form  a  M-Walsh-Fourier  transforms  pair.V 


It  is  incidently  noted  that  similar 
results  for  Hadamard  transforms  have 
been  also  obtained  | 4 | ,  using  different 
approach. 


cjonality 


kerne 

It  is  maintained  that 
7  Statement  2 

a. CdjjfxepR);  p  *0,1, . .  ,M-1)  and 

b.  {dy  (x  ©q2R)  ,  d^x  ®(2R-1)  *q2R) ; 

q  =0,1,.., iM- i ) 

are  two  uncomplete  orthogonal  sets.V 

Proof  It  is  first  noted  that  the  trans¬ 
form  of  a  WF  kernel  ^(x)  is 

M-l 

D„  (u)  *  Z  S  (u  ©  j)  (15) 

M  3=0 

Applying  the  Parseval’s  theorem 

N-l 

Z  dM(x  ®  pR)  dyfx  *  qR)  = 

N-l 

=  N  Z  DM (u)wal (u,pR)wal (u,qR) ; 
u=0 

M-l 

=  N  I  wal(u,pR)  wal(u,qR);  from  Eq.8, 
u=0 

=  N  <3m ( (p  ®  q) R)  ;  from  Eq.10, 

,NM  for  (p®q) R=0 , . . ,R-1 ,  ie,  p=q 
"'o,  otherwise. 

Fence  the  statement  2a.  is  proven. 

The  proof  of  the  statement  2b.  can  be 
obtained  as  a  replica  of  the  above  mroof, 
then  omitted. 

Fgjer  Sum  and  Dyadic  Derivative 

Let  the  Fgjer  sum  and  tne  Fgjer  kernel 


be  defined. 

respectively  as 

the  follows 

q  _ 

ff„(x)  =  q  * 

l  f_(x)  , 

(17) 

q 

p-i  p 

Kq(x)  =  q”1 

q 

Z  d  (X)  . 

P-1  P 

(18) 

Substituting  Eq.9  into  Eq.17  results: 

o  (x)  =  N  1  Ne1  R  {j  9x)  f -j) 
j-0  q 

=  Kg  (x)  #  f  ix) .  (19) 

Thus,  0q(x)  equals  tlie  weighted  average 
of  f(x)^with  Fgjer  kernel  as  weight. 

Furthermore,  from  Eqs  6  i  17,  by  a 
simple  calculation 

q-i 

0_(x)  Z  (1- (u/q) )  F (u)  wal (u,x) .  (20) 
q  u=0 
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A 


/ 


Let  now  q  =  N,  Eq,20  can  be  written  as 
N-l 

Z  uF(u)wal(u,x)  =  N[f  (x) -c „  (x) ] .  (21) 

U=0  N 

The  left  hand  side  of  Sq.21  is  the  lo¬ 
gical  derivative  of  the  second  kind, 

(x)  as  defined  in  j  3 1 .  Then, 

V  Statement  3 

f{1}(x)  =  N[f(x)-aN(x)],  (22) 

in  words,  at  every  point  x  *  0,1,.., N-l, 
the  value  of  the  logical  derivative  of 
the  second  kind  is  equal  to  N  times  the 
error  in  the  appro  \mation  of  f(x)  by 
the  Ffijer  sum  cN(x).  7 

Finally,  combin' ng  Eq.19  with  q  =  N 
and  E<~  12 ,  and  noting  1 3  j 

N6fl)(x)  «  f (at)  =  f{1}(x) 
lead  to 

K^x)  -  NS(x)  -  6{1}(x).  (23) 

Eq.23  expresses  the  Fdjer  Kernel  in  terms 
of  delta  function  and  its  dyadic  deriva¬ 
tive. 

Sampling  Expansions 

Let  C  *  2C  and  M  ■  2m  and  C,  C+M  <  N 
and  R  be  determined  by  Eq.lOa. 

V  Definition  1 

A  function  f(x)  is  said  M-sequency 
band-limited  signal,  (HEL) ,  if  its  WF 
transform  F(u)  is  zero  for  u  %  M.  V 

7  Definition  2 

A  function  f (x)  is  said  M-sequency 
band-pass  signal,  (MBP) ,  if  its  WF  trans¬ 
form  F(u)  is  zero  outside  C  <  u  <  C+M. 
More  specifically  f(x)  is  said  to  be 

*  a  narrow  band-pass  signal,  if  C  >M 

*  a  wide  band-pass  signal,  if  C<M. 

The  value  M  is  called  sequency  band¬ 
width  of  f(x).  C  is  the  cutoff  low 
sequency,  C+M  is  the  cutoff  high 
sequency.  V 

Various  Forms  of  Sampling  Expansions  for 
HSl  signals 

It  is  maintained  that  if  f(x)  is  a  MBL 
signal  then  f(x)  can  be  reconstructed 
completely  from  its  M  values: 

V  Statement  4 

-i  «-l 

f(x)  -  M  A  Z  f(pR)  cL  (x  *  pR).  (24)7 

p=0  " 

V  Statement  5 

_!  M-l 

f(x)  =>  M  x  Z  f(pR«a)  dj.(x*pR®a)  (25) 

p=0 

where  a  is  an  arbitrary  integer  in  Bn<  7 
7  Statement  6 

f(x)  -  M-1  f  (p2R)dM(x®p2R) 

p°0 


,  JM-1 

+  M  x  Z  f (p2R©(2R-l)) 

P=0  dM(x®(2R-l)®p2R)  (26)7 

Investigating  Eqs. 24 ,25626  the  fol¬ 
lowing  comments  can  be  obtained. 

Eq.25  is  a  general  form  of  Eq.24.  Ap¬ 
plications  of  Eq.25  could  be  useful  in 
signal  multiplexing. 

Using  Eqs.24  and/or  25  the  M  sampling 
points  are  equidisrantly  spaced  on  the 
x-axis,  while  for  Eq.26  the  sets  of  M 
sampling  points  is  divided  into  two 
groups,  each  of  these  groups  is  formed 
by  $M  sampling  points  regularly  distri¬ 
buted  on  the  x— axis .  These  different 
results  are  obvious  in  the  light  of 
Statement  2.  The  sampling  points  are  il¬ 
lustrated  in  Fig.l  with  N=16  and  M-4. 

The  proof  of  Statement  4  is  based  upon 
the  following  lemma. 

7  Lemma 

R-l  iM-1 

Z  wal  (pK,x)  =  R  Z  6  (x  ©p2R)  (27) 

p=0  p=0 

JM-1 

+  R  Z  6 (x©(2R-l)«p2R) .7 

p=0 

Proof  of  this  lemma  is  given  else¬ 
where  1 5  |  . 

Proof  of  Statement  4.  The  following 
proof  uses  the  convolution  technique. 

Let  consider  the  impulse  train 
M-l 

h  (x)  =  NR  £  6  (x  $  pR)  .  (28) 

p=»0 

Its  WF  transform  is 
M-l 

H (u)  =  R  Z  wal(pR,u).  (29) 

p=0 

Applying  the  above  lemma,  with  x,  M 
replaced  respectively  by  u,  R, 


iR-1 

H(u>  “  N  T, 

6  (u  ®  p2M) 

p=0 

iR-1 

+  N  Z 

6  (u«(2M-l)«p2M) 

p=0 

Let  F (u)  be  the  WF  transform  of  an 
arbitrary  MBL  signal  f(x).  Consider  the 
logical  convolution  F(u)*d(u),  with  H(u) 
given  by  Eq.30, 

iR-1 

F(u)#U(u)  =  Z  ?(u*p2M) 

p=0 

iR-i 

+  Z  F(u®(2M-l)«p2M) .  (31) 

p=0 

Eq. 31  is  illustrated  in  Fig. 2b  for  N“16 
and  M*4 ,  Investigating  Fig. 2b  suggests 
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that  to  regain  F(u)  it  is  sufficient  to 
multiply  F(u)*H(u)  by  the  function  W(u) 
shown  in  the  Fig. 2c; 

F (u)  «  (F(u)  •  H(u)}.W(u).  (32) 

Eg. 32  can  be  obtained  from  Eq.31  by 
noting  that,  for  p=0  and  u=0,l..,H-l,  the 
second  member  of  Eq.31  is  exactly  equal 
to  F(u) . 

The  inverse  transform  of  Eq.32  is 

f (x)  =  N_1{f(x).h(x)}  •  w (x) .  (33) 

Substituting  Eq.28  into  Eq.33,  and  by 
some  manipulations 

M-l 

f(x)  =  M  A  Z  f(pR)  w(x«pR).  (34) 

p=0 

From  Eq.15,  it  is  clear  that 
w(x)  =  d„(x).  (35) 

Hence  Eq.24  is  proved  by  substituting 
Eq.35  into  Eq.34. 

Proof  of  Statement  5.  Proof  of  this 
statement  is  straightforward  by  applying 
Eq.24  to  f (x  ®  a)  which  is  a  MBL  signal, 
and  replacing  x«a  by  x  in  the  sampling 
expansion  of  f (x  ©  a) . 

Proof  of  Statement  6.  Proof  of  this 
statement  is  very  similar  to  that  of 
Statement  4.  The  only  difference  is  to 
start  with  the  following  function  instead 
of  Eq.28. 

Jm-1 

h  (x)  =  NR  Z  {6(x«pR)+6(x»(2R-l)«p2R)) 

p=0 

whose  WF  transform  is 
R-l 

H(u)  =  N  Z  6  (u  *  pM)  . 

p=0 

To  save  space  other  details  of  calcu¬ 
lation  are  omitted. 

Sampling  Expansions  for  MBP  Signals 

The  WF  transform  of  a  MBP  signal  f (x) 
of  cutoff  low  sequency  C  is  given  by 

C+M-l 

F (u)  =  Z  *'-.F(j)  «(u  •  j).  (36) 

j=C  ^ 

It  is  maintained  that 

7  Statement  7  If  f(x)  is  a  narrow  band- 
pass  signal  then 

.  M-l 

f(x)  Z  f  (pR)cL.(x»pR)wal(C,X®pR)  . 

p=0  (37)7 

Proof 

If  C  >  M  then  j-C  =  jtc  for 
j=C,.., C+M-l  .  Thua  E-.36  becomes 

M-l 

F(u)  =  Z  F(r«C)  &  (u  »r  ®C) .  (38) 

r«0 


Let  define 

a(x)  =  f (x)  wal (C,x)  (39) 

or 

f(x)  *  a(x)  wal(C,x).  (40) 

From  Eq.38,  it  is  easy  to  see  that 
the  WF  transform  of  a(x)  is 

M-l 

A(u)  =  F(ueC)  =  Z  F  (r+C)  6  (u+*r) . 
r=0 

a(x)  is  then  a  MBL  signal.  Applying 
Eq.24  to  a(x),  and  using  Eqs.  39  6  40  a 
simple  calculation  gives  Eq.37,  hence 
Statement  7. 

To  derive  a  sampling  expansion  for  a 
wide  band-pass  signal  f (x)  the  following 
definition  is  first  introduced. 

7  Definition  3  The  i-th  signal  of  the 
set  of~S  m  CBL  signals  associated 

with  f (x)  is  defined  by 

fj_(x)  =  f  (x)wal(iC,x)  9  dc(x),  (41) 

x  m  1,2 ,...,S*  7 

The  set  of  CBL  signals  associated 
with  f (x)  can  be  generated  by  the  dyadic 
system  shown  in  Fig. 3. 

It  is  maintained  that 

7  Statement  8  If  f(x)  is  a  wide  band- 
pass  signal  then 

S  C-l 

f(x)»C-1  Z  Z  f, (PT)wal(iC,x)dr(x®pT) 

i=l  p=0  1  °  (42) 

wfiere  T  =  NC_1.  7 

Proof  For  C  <  M,  Eq.36  becomes 
S  C”1 

F(u)  «  Z  Z  F(r©iC)6(u®r®iC).  (43) 

i=l  r=0 

Investigating  Eq.43  shows  that  F(u)  can 
be  considered  as  the  sum  of  S  narrow 
band-pass  signals  a^(x)  of  bandwidth  C. 

C-l 

A. (u)  =  Z  F(r*iC)6 (u®r®iC)  (44) 

1  r=0 

where  i  “  1,2,. . ,S. 

From  Eqs. 41  &  44  it  is  easy  to  see 
that  the  transform  F. (u)  of  the  i-th  CBL 
signal  associated  with  f(x)  satisfies 

Ai(u)  =  Pi(u  1  iC) .  (45) 

Substituting  Eq.45  into  Eq.43,  then 
taking  the  inverse  transform  gives 

S 

f(x)  =  Z  f4  (x)  wal (iC,x) .  (46) 

i=l  ‘ 

Applying  Eq.24  for  each  CBL  signal 
f j (x) ,  and  replacing  the  results  into 
Eq.46  give  Eq.42.  Hence  Statement.  8. 
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Sampling  Expansion  for  Some  Specific 
Spectrum  Sionr'* ' 


In  the  al  statements  it  has  been 
proved  that  .*(x)  is  MBL  or  MBP  signal 
then  f(x)  can  be  regained  from  only  M 
samples,  properly  chosen.  Consider  a 
function  f(x)  whose  Walsh  spectrum  has 
only  M  components,  but  it  cannot  be  con¬ 
sidered  neither  as  a  MBL  nor  as  a  MBP 
signal.  The  following  q>  j&tion  could  be 
asked.  TJow  one  can  regain  this  signal 
from  only  M  properly  chosen  samples?" 

A  partial  but  useful  answer  can  be  ob¬ 
tained  as  follows  in  the  case  where  the 
Walsh  spectrum  has  some  specific  patterns. 
It  is  known  that  there  exits  a  one-to-one 
correspondance  between  Walsh  and  Hadamard 
functions  | 3 | .  Let  define  three  new  clas¬ 
ses  of  signals  whose  Walsh  spectrum 
components  are  "MBL  or  MBP"  components 
in  the  Hadamard  domain.  Then  this  above 
problem  could  be  cc  isidered  as  solved 
for  these  new  classes  of  signals,  if 
sampling  expansions  using  Hadamard  func¬ 
tions  are  known.  Fig. 4  illustrates  this 
technique  for  a  signal  whose  Walsh  spec¬ 
trum  components  are  transformable  into 
MBL  components  in  Hadamard  domain,  for 
N  ••  16  and  M  *  4 . 

The  above  technique  can  be  generalized 
to  cover  other  specific  signals  whose 
Walsh  spectrum  is  transformable  into  a 
MBL  or  MBP  spectrum  in  other  domains 
(provided  that  there  exists  a  one-to-one 
mapping  between  these  domains  and  Walsh 
domain) . 

In  the  following,  the  sampling  expan¬ 
sions  using  Hadamard  functions  are  con¬ 
sidered. 

Let  the  Hadamard  kernel  be  defined  as: 


d£(x)  =  T.  <|/(k,x).  (47) 

It  is  claimed  that: 

V  Statement  9 
The  set 

(d^(x  »p)  ;  p  =  0,1,.., M-l) 

is  uncomplete  orthogonal  one.  7 

V  Statement  10  If  f(x)  is  a  Hadamard 
MBL  signal  then  f (x)  can  be  regained 
without  error  using  its  M  first  values. 

-1  M_1  H 

f(x)  =  M  A  I  f(p)  d£(x®p).  (48) V 

pc  0  M 

7  Statement  11  If  f (x)  is  a  Hadamard 
narrow  band-pass  signal  with  cutoff  para¬ 
meters  C  and  C+M  then 

-1  M_1  B 

f(x)  «  M  A  Z^  f  (p}dj}(x+p)i|i(C,x+p)  .  (49)7 

7  Statement  12  If  f(x)  is  a  Hadamard 
wide  bandpass  signal  with  cutoff  para¬ 
meters  C  and  C-iM  then 


f(x)  =  C 


where 


S  C-l 


Z  Z  f"(p)iKiC,x)d"(x#pX$0> 
i=*l  p=0  1  ^ 


f£(x)  =  f(x)  <MiC,x)  •  d“(x)  (51) 

is  the  i-th  signal  in  the  set  of  S  =  MC_1 
Hadamard  CBL  siqnals  associated  with 
f (x) •  V 

Proofs  of  Statements  9-12  can  be  ob¬ 
tained  by  use  the  same  techniques  given 
in  the  foregoing  analysis,  hence  omitted. 

It  is  interesting  to  note  that  the  WF 
kernel  can  be  considered  as  member  of  a 
set  of  interpolation  operators,  while 
the  Hadamard  kernel  defined  by  Eq.  47  as 
member  of  a  set  of  extrapolation  opera¬ 
tors  . 

Various  Bounds 


Sounds  involving  MBL  signals  can  be 
estimated  by  using  the  concept  of  maximun 
response  |6|  of  dyadic  linear  systems. 
Applying  the  well-known  Schwarz ' inequal¬ 
ity,  the  following  results  are  easy  to 
be  obtained. 

Maximum  response  of  Dyadic  Linear  Systems 

Let  f (x)  be  a  MBL  signal  with  bounded 
energy  E: 

N-l 

E  *  Z  f^(x).  (52) 


If  f (x)  is  the  input  to  a  dyadic  line¬ 
ar  system  defined  by  its  response  h(x)  to 
the  impulse  N6 (x)  or  by  its  system  func¬ 
tion  H(u)  then  the  system  output  g(x)  is 
upper  bounded 


This  bound  is  attained  at  a  predeter¬ 
mined  value  xQ  only  if  the  input  is  given 
as  follows: 

fQ(x)  =  ah(x  $  Xq )  •  dM(x).  (54) 

where  the  constant  a  is  determined  in 
such  a  way  that  the  energy  of  fQ (x)  be 
equal  to  E.  u 

In  the  case  where  M  =  N 
h(x)  =  a-1fQ(x  +  x0)  (55) 

is  called  dyadic  matched  filter  for  fQ(x). 

Signal  bound  From  Eq.53  it  is  easy  to 
see  that  for  H(u)  =1 

I  f  <x)  |  6  E^-5  .  (56) 

Dyadic  Derivative  Bound  Applying  Eq.23 
with  H(u)  ■  u  gives 

|f(1)(x)|  c  p-liJM-l'P  .  (57) 


The  above  estimated  bounds  are  useful 
for  predicting  computer  memory  in  the 
processing  of  signal.  In  the  following , 
the  error  bound  in  the  approximation  of 
a  sequency  limited  signal  by  a  MBL  will 
be  considered. 

Aliasing  Error 

Consider  a  function  f (x)  whose  W? 
transform  F(u)  is  zero  for  u  >  U.  Suppo¬ 
se  that  M  <  0  <  2M+1.  Let  f(x)  be  appro¬ 
ximated  by  the  MBL  signal 

M-l 

f  (x)  =  M  i  I  f  (pR)  d^x  *  pR). 

3  p=0  “ 

The  error  in  this  approximation 
e  (x)  =  f(x)  -  f  (x)  (58) 

a  a 

is  called  aliasing  error.  It  has  been 
proved  j  5  j  that  e„(x)  is  upper  bounded 

u 

|ea(x)  B|wal(M,x)-wal(M-l,x) |  (59) 


where 


N-l 
B  =  I 
U=M 


i  F  (u)  | 


It  is  incidently  noted  that  for 
Hadamard  MBL  signal  approximation,  the 
resulted  error  is  similar 

|e£(x)  |  «?  BH|  i|>(M,x)-l|  (6C 


where 


jFI!(k) 


Investigating  Eq.59  (or  Eq.60)  shows 
that  the  approximation  of  f(x)  by  fa(x) 
is  exact  at  iN  points  x  such  that 
the  expression  in  the  absolute  sign  of 
Eq.59  is  zero.  At  the  rewa_ning  JN 
points  the  error  is  upper  bounded  by  2B. 


Conclusion 
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Fig,  I  0- PERIODIC  SAMPLING  POINTS  USING  EO  24 


The  well-known  concept  of  partial  sura, 
Fourier  kernel ,  F6jer  sum  and  F6jer  ker¬ 
nel  in  Fourier  analysis,  are  generalized 
into  Walsh  domain  for  investigating  dis¬ 
crete  and  finite  functions.  The  FSjer  sum 
in  Walsh  domain  leads  to  an  interpretation 
of  the  dyadic  derivative  of  the  second 
kind.  The  WF  kernel  is  proved  to  be  use¬ 
ful  in  investigating  of  truncated  Walsh 
finite  series.  Its  orthogonality  proper¬ 
ties  yield  various  sampling  expansions. 
Using  these  sampling  expansions  MBL  «nd 
MBP  signals  can  be  recovered  without 
error  using  M  properly  chosen  samples. 

The  introduction  of  the  Fourier-Hadamf'd 
kernel  leads  to  similar  results.  Further¬ 
more,  it  enlarges  the  class  of  signals  that 
can  be  recovered  without  error  from  its 
M  properly  chosen  samples  to  include  those 
for  which  the  Hadamard  spectrum  is  either 
MBL  or  MBP  components.  Various  bounds 
involving  discrete  and  finite  signals  are 
estimated.  These  bounds  are  useful  in 
siqnal  processing  and  in  approximating 
a  given  signal  by  a  MBL  signal. 


b-  SAMPLING  POINTS  USING  E0.  26 
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Fig,  2  PROOF  OF  STATEMENT  4 
0- ORIGINAL  SPECTRUM 
b- SPECTRUM  OF  SAMPLED  SIGNAL 
c-  SPECTRUM  OF  FILTERINGKERNEL 


270 
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1.  Introduction 

Walsh  transforms  have  become  a  very 
important  instrument  in  science  and 
technique  daring  the  recent  years.  Es¬ 
pecially  in  filter  theory  [ 1,8,9 ],  pic¬ 
ture  processing  [4]  and  pattern  recog¬ 
nition  [10]  it's  application  increased 
rapidly.  Sequency  theory  leads  to  a 
generalisation  of  filter  concepts,  and 
in  signal  processing  the  possibility  of 
redundancy  reduction  by  means  of  Walsh 
transforms  is  a  main  topic. 

Caused  by  the  nigh  data  rates  of 
natural  signals  (as  speech  or  image 
signals)  computer  aided  methods  must 
use  fast  and  storage  saving  algorithms. 
Fast  "in  place"  algorithms  to  perform 
the  Walsh  transform  in  unordered  form 
are  well  known  [5.6].  But  especially  m 
filter  technique  the  order  of  sequency 
related  to  the  Walsh  coefficients  is 
important.  Until  r.ow  a  fast  "in  place" 
algoritlim  to  compute  tha  Walsh  coeffi¬ 
cients  in  order  of  sequency  has  not 
been  published.  In  [11]  Ulman  even 
asserts,  that  such  an  in  place  algorithm 
cannot  exist,  and  one  has  to  spend  at 
least  2*M  storage  locations  for  M  input 
samples.  On  the  contrary  this  paper 
describes  a  fast  in-place  algorithm  to 
perform  the  ordered  discrete  Walsh 
transform  using  only  a  few  more  storage 
locations  than  input  samples. 

2.  Discrete  Walsh  Transforms 


Let  Z1  be  tne  set  of  complex  numbers, 
and  A  be  the  set  of  discrete  functions 
x£  A  with  the  following  properties: 


x (k) €  Z1 

for  all 

k  €  Rjj  :=  (0,  . . 

.  ,M-1 } 

M  =>  2N  ; 

(1) 

N  >  0?  N 

integer?  N  <  “ 

(2) 

M-l 

l|X||  := 

I  |x(k) 
k=0 

|  *  <  W 

(3) 

In  A  the 

set 

E  :-  (yu 

|u€  Bn) 

(4) 

form  a  complete  orthogonal  set,  if 


<  k,u> 


yu(k)  =  (-D 

(5) 

with 

N-l 

<k,u>  =  Z  k.u. 

i=0  1  1 

(6) 

k  =  (kN-lkN-2  *  *  *  ko>  2 

(7) 

and 

a  '  (uN-luN-2  '•*  uo>2 

(8) 

are  the  binary  representations 
u  respectively. 

of  k  and 

The  transform 

M-l 

D  (u)  =  Z  y  (k)x(k)  £  A 
x  k=o  u 

(9) 

for  all  u€  B  ,  and  for  each  x£  A,  may 
be  called  unordered  Walsh  transform. 
The  basis  functions  y  are  disciete 
Walsh  functions. 

Let  Ln  be  a  one-to-one  function, 

Ln  :_Bn  BN,  with  the  property,  that 
for  u  :  =  Lfj(u)  holds: 

UN-1  ;  £or  1  =  0  CO) 

“N-i  ®  uN-i-l  >’  for  if 

N—  1 } 

©  denotes  mod  2  addition. 

The  Walsh  coefficients  D  (u)  of  function 
x  in  order  of  sequency  are  computed  by 
means  of 

Dx(u)  =  Dx(u)  =  D.((Ln(u)) 

M-l 

=  Z  y-(k)x(k)  (ID 

k=0  u 

The  basis  functions  y—  can  be  written 
in  the  form 

<>■  ,u> 

y^(k)  =  (-1)  =  walu(k)  (12) 

The  eight  discrete  Walsh  functions 
walu(k)  in  sequency  order  with  respect 
to  M  =  8  are  shown  in  figure  1.  Equa¬ 
tion  (11)  may  be  called  Walsh  trans¬ 
form  in  sequency  order. 
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/ 


/ 


(15) 


wal0  (k) 
wal,  (k) 
wal2  (k) 
wal3  (k) 
waU,  (k) 
wal5  (k) 
wal6  (k) 
wat7  (k) 


1  1  1  1  !  1  1 

k 

]  1  •  L  .  , 

1  1  1  i  k 

1  L  X  1  1  r 

_ i 

1  1  1  1  k 

1  1  1  , 

II  II 

II  II  L 

IV 

III  1  k 

t  1  ,1,1 

1  1  1  1  k 
...  1  1  l 

•  .  '  '  k 

Fig.  is  Discrete  Walsh  Functions  in 

Order  of  Sequency.  N  =  3,  M  =  8. 

3.  Speciai  Properties  of  the  Function 


The  following  properties  of  LN,  which 
can  be  proved  easily,  are  helpful  in  the 
later  discussions. 

A) 


Ln(u) 

=  BR^u  ®  SR(u)  ) 

(13) 

brn  : 

bit  reversal 

SR  : 

shift  ight  one 
filled) 

bit  (left  zero 

« 

bit  per  bit  mod 

2  addition 

U  € 

Bt’ 

B)  Inverse  function  L^1  (Def: 

L^(LN(k))  »  k): 

,  N-l 

C  (u)  =  SRr[  BR (u)]  (14) 

r=0 

^  :  bit  per  bit  mod  2  summation 

SRr  :  shift  right  r  bit  (left  zero 
filled) 


Y-W  =  yu(k) 
k,u  6  Bn 


D)  (0)  =  0  for  all  integer  N  ^  o  (16) 

E)  There  exists  one  and  only  one 
0  4  kQ(N)  6  Bfj,  with 

LN(ko(N))  =  kQ(N)  (17) 

if  and  only  if 

N  =  3s+l  for  all  integer  s  >  O  ,  (18) 

having  the  value 
1 

k0(N)  =5*1  23r  +  2N-1  (19) 

r-0 

The  indices  k0(N)  and  O(zero)  shall  be 
called  "fix  points"  with  respect  to  Lfj. 


4,  Fast  Algorithms  and  Assorting 
Problem 


Fast  algorithms  to  compute  the  un¬ 
ordered  Walsh  coefficients  “in  place" 
are  well  known  [5,6].  Having  computed 
the  coefficients  in  unordered  form, 
they  can  be  assorted  into  order  of  se¬ 
quency  (decimation  in  sequency) .  On 
the  other  hand  it  is  possible  to  assort 
the  input  values  x(k),  k €  BN  in  such  a 
way,  that  the  unordered  transform 
applied  to  this  shuffled  input  sequence 
yields  coefficients  in  order  of  sequei  - 
cy  (decimation  in  time) . 


The  assortment  is  simply  done  by  use 
of  a  second  memory  field  (Dx  or  x) : 

A)  Decimation  in  Sequency 

Following  equation  (11)  the  assor¬ 
ting  algorithm  is: 

V  :  Dx(u) — *  D„(L"1(u))  (20) 


u€BN 

B)  Decimation  in  Time 

Inserting  equation  (15)  into  (11) 
yields 

M-l 

D„(u)  =  l  yu(LN(k))x(k) 


x 

or 


(2r- 


k=0 

M-l 


■  "I , 


D  (u)  =  l  y  (kl)  x  (Lm  (kl ) ) 
x  kl=0  u  N 

M-l 

=  l  y  (k)  x(k)  -  D— (u) 
k=0  u  x 


(22) 


u  e  % 

C)  Let  u  =  Ln(u)  and  k  =  LN(k) ,  then 


Hence  the  assorting  algorithm  is 

V  :  x(k)  — *■  x(LM(k) )  .  (23) 

k6  BN 
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5.  "In  Place"  Solution  of  the 
Assorting  Problem. 

Assorting  "in  place"  is  a  problem, 
because  in  general 

L^(k)  :=  LNU-N(k))  4  k  .  (24) 

That’s  why  assorting  can't  be  done  only 
by  multiple  exchanging  of  two  input 
samples  or  coefficients  (like  "bit  re¬ 
versal"  assorting  in  FFT  algorithms) . 

But  with  respect  to  the  function  LN, 
defined  in  (10)  or  (13)  a  "subsequent" 
"in  place"  assorting  using  two  further 
memory  locations  (HI  and  H2)  is  possi¬ 
ble. 

Example : 

Let  N  =  3,  M  =  8  then: 

L3(l)=4,  L3(4)=3,  L3(3)=2,  L3(2)=6, 
L3(6)=5,  L3(5)=7,  L3(7)=l 

or: 

Lj ( 1) =4  ,  L3(l)=3,...,  L3 ( 1) =1 

Figure  2  shows  the  necessary  cyclic 
shuffling  for  decimation  in  time. 


x  (7)  *•  HI 
<H2>  7 

<H1>  -*•  H2 

Stop:  <H2>  ->•  1 

In  the  example  N-3  the  whole  input 
field  x  is  assorted  in  one  "cycle"  be¬ 
ginning  and  ending  at  an  available 
kifiB3~{0}  (here:  ki=l). 

For  N  =  4  there  exist  two  cycles: 

f|4)  =  (1,8,3,4,6,10,15) 

F<4>  =  {2,12,5,14,9,11,7} 

The  total  i  iput  field  is  assorted  by 
running  throui  '1  both  cycles  starting  at 
available  ent r  -  points  kj6  F|4)  and 
k2  6  f!4>  .  Becc-u^e  0  and  13  are  fix 
points,  x(C)  and  x(13)  remain  unchanged. 

Introducing  fix  points  (index  0  and 
perhaps  one  more  fix  point  k0(N))  to 
be  cycles  of  length  1 ,  these  cycles 
form  a  partition  of  BN  defined  by  the 
function  LN. 

A  general  formulation  of  this  fact 
is  as  follows- 

N 

For  each  N>1,  integer,  and  M=2 
exists  a  set  C <N> ={ 1 ,2 . . . . ,r (N) }  and  a 
partition  (Fj[N)  |  i  6  C  (NM  of  BN  with  the 
property: 

v/  3  V 

-  <(l4)  u(i)  €  {1,.  . .  ,M-1 }  k  6  f|N) 

a)  L“(i)  (k)  =  k  and  (25) 

N 

b)  V  V 

u(i)4l  s €  { 1 , . . . ,u (i) -1 } 


Fig.  2:  Assorting  "In  Place”  in  the 
Case  N  =  3 

Starting  the  "in  place"  assorting  at 
index  1 ,  decimation  in  time  is  per¬ 
formed  by  the  following  steps  (<Hl>de- 
notes  "content  of  memory  location  with 
symbolic  address  HI"): 

Start:  x(l)  - 

x  (4)  -*- 
<H2>  ♦ 

<H1>  + 

x  (L^  ( 1) )  ~ 

J  H2 

HI  - 


H2 

HI 

4 

H2 


Hi 

1*2  (1) 
H2 


:  L®(k)  4  k  (26) 

Now  let  G(N)  =  { ki | i 6  C(N); 

k^6  Fj_  ^  }  be  a  set  of  entry  points  be¬ 
longing  to  the  cycles  f|n) .  Decimation 
in  time  is  then  performed  by 


V 

:  x(k<) — 

->x(L^(ki)) 

g(N)  HI, 

,H2  1 

- 1 

►  x(Li}(i)  (M) 

=  x (k,)  , 

HI  ,H2 

and 

decimation  in 

sequency  by 

(27) 


1 

t 

; 


i 

t 
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^ ^ iris**** 


V  :  W - "Dx(LN1(ki}) - * 

k.€  G(N)  H1/H2  x  HI , H2 

-Dx(L^u(i)  (kj.))  =  Dx(ki)  .  (28) 


HI  ,H2 

6.  Realization  in  a  Computer  Program 


data  field) . 

We  also  wrote  a  Walsh  subroutine 
using  a  second  field  into  which  the  in¬ 
put  data  is  schuffled  (no  "in  place" 
method) .  This  subroutine  has  a  total 
length  of  149 10  memory  locations  (ex¬ 
cluding  the  two  data  fields) . 


Until  now  we  didn't  find  an  explicit 
expression  to  compute  a  set  of  entry 
points  of  the  cycles  for  arbitrary 
choice  of  N.  Therefore  entry  points  for 
all  1  £  N  <_  14  were  computed  in  a  se¬ 
parate  search  program. 

For  N  =  1,2,3,5,6,9,11,14  the  number 
of  cycles  is  r(N)  =  2,  i.g.  =  {2}, 

and  F(N)  =  B  -{0},  F*N)  =  {0} .  Because 

W  *  IK\ 

0  is  a  fix  point  only  F^  1  is  of  inte¬ 
rest.  An  arbitrary  entry  point 

k. €  f|N^  -  B  -{0}  can  be  chosen  (we 
cnoseK^  =  fl. 

For  N  =  4,7,8,10,12,13  is  r(N)  >  2. 
Table  1  shows  the  computed  entry  points 
(except  the  fix  point  zero) . 


4 

7 

8 

10 

12 

13 

1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

4 

2 

13 

4 

4 

7 

19 

7 

(fix) 

7 

7 

8 

26 

11 

11 

8 

11 

1585 

13 

13 

11 

13 

16 

14 

13 

16 

19 

19 

14 

19 

22 

22 

19 

22 

25 

49 

21 

26 

26 

109 

22 

28 

35 

(fix) 

26 

35 

38 

28 

38 

41 

35 

41 

69 

49 

55 

81 

52 

91 

100 

59 

110 

769 

81 

193 

1154 

117 

877 

7021 

(fix) 

(fix) 

•Table  Is  Entry  Points  in  the  Case  of 

Multiple  Cycles  with  r(N)  >  2. 

Excluding  fix  points  and  the  number 
1,  being  entry  point  of  the  first  cy¬ 
cle  for  all  N ,  the  entry  points  of 
table  1  are  stored  in  the  fast  "in 
place"  Walsh  subroutine  by  a  data  de¬ 
claration.  The  subroutine  uses  decima¬ 
tion  in  time.  On  a  CDC  6400  computer 
the  total  subroutine  length  is  272^q 
memory  locations  (excluding  the  input 


Therefore  the  "in  place"  algorithm 
is  memory  saving  for  all  N  ^  7 . 

The  computation  times  of  both  sub¬ 
routines  are  nearly  the  same . 
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INTRODUCTION 

The  Walsh-Hadamard  or  BIFORE  (Binary  FOuier 
Representation)  transform  and  related  spectra 
Cl]  have  found  several  applications  in  pattern 
recognition  problems  [2,')  »].  Recently  Ohnsbrg 
[4]  defined  additional  ctral  modes  for  the 
Walsh-Hadamard  transform  (WHT)  which  could  also 
find  applications  in  pattern  recognition  problems. 
These  spectral  modes  are  (i)  the  quadratic  spectrum 
and  (ii)  the  optimum  quadratic  spectrum.  However, 
it  is  a  laborious  task  to  compute  these  spectra. 

Tc  this  end,  the  main  objec*"“e  of  this  paper  is 
to  present  efficent  algo.  .113  which  enable 
rapid  computation  of  the  WHi  quadratic  and  optimum 
quadratic  spectra. 

WALSH-HADAMARD  TRANSFORM  (WHT) 

Consider  a  real-valued  N-periodic  data 
sequence  (x(n)}  *  (  xQ,  x^  ••••Xu  n=log  N. 

If  the  vector  representation  of  (x(n)}  is  denot¬ 
ed  by  (x(n)  ),  then 


(&(n)} 


(x0  Xl 


"Vi1 


where  (x(n)}' denotes  the  transpose  of  (x(n)). 

The  WHT  of  (x(n)3  is  defined  as  [1] 

{X(n)>  =  i  [H(n)]  (x(n)}  (1) 

N 

where  (X(n)}' =  {X  X  ••••  XN_1>  is  the  WHT  vector, 
and  [H(n)3  is  the  (NRN)  Hadamard  matrix.  Let 
{x*l'(n)}  denote  the  sequence  obtained  by  shift¬ 
ing  (x(n))  by  i  positions  to  the  left.  That  is, 

{*<  \n)}  =  (x^  Xj+i . >  4  =  1,2, .  ..(N-l) 

If  {i(t)(n)}'  =  (Xq1)  x[l>  --'X^H  denotes  the 
WHT  vector  of  (x(t)(n)},  then  I^can  be  shown 
that  [1] 

(X(t)(n)>  =  [A(n)]l(!((n)}  <3> 

where  i 

CA(n)]  =  jj  CH(n)]  [M(n>]  [H(n)], 

[A(n)3l  is  [A(n>]  raised  to  the  power  i, 
and 

[M(n)3  is  the  (2nx2n)  identity  matrix,  whose 
columns  are  shifted  cyclically  to  the  right  by 
one  place. 

The  matrix  [A(n5]  is  called  the  WHT  "shift  matrix" 
since  it  relates  the  WHT  of  the  shifted  sequence 
to  that  of  the  original  sequence.  It  has  a 
"block  diagonal"  structure  since  it  is  of  the 
form 

[A(n)3  =  [B(0>]  ©  [B(0)3  ©  CB(l)]---®  [B(n-1)3K1|) 


where,  [B(0)3  =  [B(0)3  ■  l,and  each  of  the  (2™x 
2™)  matrices  [B(m)3,  m  =  1,2,* ••(n-l)  is  ortho¬ 
gonal. 

SPECTRAL  MODES  OF  THE  WHT 

The  shift  matrix  [A(n)3  in  (3)  yields  the 
familiar  WHT  power  spectrum  in  a  straightforward 
manner  [1].  However,  two  additional  modes,  name¬ 
ly  the  WHT  quadratic  and  optimum  quadratic 
spectra  [5],  have  also  been  developed. 

(i)  The  WHT  quadratic  spectrum:  This  spectrum 
is  defined  as 

Qo  =  *o 2 

Qm.q  »  tXk)l  [B(m-l)]<l  {X*}.  (5) 

2m_1  <  k  <2m,  0<q<2m_2,  0<m£n 

where, 

"  ^X2m-1  X2m-l+l“ 

In  what  follows,  the  WHT  quadratic  spectrum  will 
be  referred  to  as  the  Q-spectrum.  It  can  be 
shown  that  [53  the  Q-spectrum  is  invariant  to 
cyclic  shift  of  the  data  sequence  (x(n)}. 

For  example,  consider  the  case  N=8.  Then, 
(5)  yields 

Q0  =  X02 


y  > 
2m-l 


“1,0 


=  X, 


^2,0  *  X22  +  X32 

2  2  o  2 

<53,0  =  V  +  X5  +  X6  +  X7 

l  2  2  2  2 

Q,  .  =  ±  CX  ^  -  X  ♦  X*  -  X/  -  2X4X7  + 

’  2  (6) 


»SX^ 


From  (S)  it  follows  that  in  general,  (S)  yields 
a  set  of  (N  +  i)  shift  invariants  each  of  which 
is  a  quadratic  form.  Thus,  as  N  increases , the 
storage  requirements  and  computational  time  in¬ 
creases  rapidly.  Consequently  alternate  methods 
which  allieviate  both  these  problems  are  desir¬ 
able.  In  this  paper,  three  such  methods  are 
presented  and  their  performance  is  compared, 

lii)  The  WHT  optimum  quadratic  spectrum:  Consi¬ 
der  the  case  N*8.  Then  the  WHT  optimum 
quadratic  spectrum  corresponding  to  (6)  is 
given  by  [5], 


J0  =  Q0 
Jl,0  =  Ql,0 
J2,0  =  Q2,0 
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[D(k+1)3 


From  (7)  it  follows  that  the  squared  terms  in 
J3  0  and  ,1  represent  the  individual  sequencies 
1  3nd  3  respectively.  In  contrast,  Qg  .  and  Qg  ^ 
represent  the  group  of  sequencies  1  add  3.  In’ 
general  it  can  be  shown  that  each  Jffl  represents 
a  single  sequency  in  its  squared  tends  besides 
being  shift  invariant.  Hen,:e  the  name  "Optimum" 
quadratic  spectrum.  For  convenience,  this  spec¬ 
trum  will  be  referred  to  as  the  J-spectrum. 

From  (7)  it  is  clear,  that  in  general,  the 
computation  of  the  J-spectrum  is  tedious, 
since  it  involves  both  the  development  and  sub¬ 
sequent  inversion  of  the  transformation  matrix 
[T(m>]  whose  order  increases  with  N.  The  gener¬ 
al  procedure  to  develop  [T(m)],  which  is  present¬ 
ed  in  [5],  requires  the  computation  of  powers  of 
the  submatrices  [B(m)]  in  (4),  which  is  a  labor¬ 
ious  task.  However,  in  this  paper  it  is  shown 
that  the  J-spectrun  can  be  rapidly  computed 
using  an  alternate  approach. 


In  what  follows,  methods  to  compute  the 
Q-spectrun  and  the  J-spectrum  are  presented  and 
compared.  In  order  to  be  brief,  details  pertain¬ 
ing  to  the  derivations  of  the  related  algorithms 
are  avoided. 

t 

COMPUTATION  OF  THE  Q-SPECTRUH 


Three  methods  can  be  used  to  compute  the  Q- 
spectrum. 

Method  I:  From  (3)  and  (4)  it  follows  that  (5) 
can  be  written  as 
Q„  =  X.2 


Vq  -  i\)'n  (4*% 

2m-l  <  k  <2m>  Q  ..  q<  2m-2>  o<  m  <  n 
where 


(8) 


<V>>. 


'c\ 

2M-i 


X 


<q> 

2m-1+l 


>. 


The  Q-spectrum  as  defined  in  (8)  do  not  require 
that  the  matrices  [B(m)l  be  stored,  as  is  the  case 
in  (5).  Again,  the  (X.  (q)}ean  be  computed  by 
successively  applying  the  fast  Valsh-Hadamard 
transform  (FWHT)  q  times  to  (x(n)}  shifted  cycli¬ 
cally  to  the  left,  q  times. 

Method  II:  Consider  the  modified  BT  or  modified 
WHT  which  is  defined  as  [6] 


{E(n»  »  |  Co(ii)]  {*<«)},  (9) 


where  (x(n)}  is  the  data  sequence,  and  {  F(n)} 
is  the  transform  vector  such  that, 

<£<"»'  '  iro  ri . FN-1>, 


and  CD(n)]  i*  defined  f 


TdU)]_  _i_[D(k)]  _ 

_2k/2[I(k)]  J  -2k/2[I'k)] 


k  —  0,  1,  • . «n 
with  [D(0)]  =  1 


The  transform  coefficients  F  k  ■  0,  1,” 

• • >(N-1) 


HHT  for  N=8. 


expressed  in  terms  of 

Fk,  k  « 

us  follows: 

*0  *  Fo2 

.  2m-l  2 

Vo  3  *  ,  V 

’  k^*1  *  > 

0<m<n 

2m-i-q 

q-i 

o  s  z  r  r 

’"♦q  ^=2m-l*k  ktq 

-  I  F 

j=o  : 

2m”\k<2n, 

0<q<2“': 

(10) 


The  Q-spectrum  as  defired  in  (10)  can  be  comput¬ 
ed  extremely  rapidly  since  it  involves  success¬ 
ive  cyclic  shifts,  sign  changes  and  dot  products 
which  is  best  illustrated  by  an  example.  Co, wide? 
N=16.  Then  (10)  yields, 

«,  ■  V 

2 


'ecurrence  relation 


0,  „  =  F 


=  F  2  +  F  2 

9  9 


kQ3,0  =  F4  +  r5  +  F6  +  F7 


m  f;  rs  p6-';  ■  Vf  *  r= r'*  r* r’ 

1  S  6  7  4  "  F7F4 


Q  =  F  2  +  F  2  +  '**•+  F  2 
v4,0  8  9  IS 

0  r  TF8  F9 . F14  F15 


=f  sr< 
‘-1  r„r 


F  F,. . 

9  10 

14 

-  F1S-F8 

iff 

-  F  F 

k=8  k  k+1 

8  15 

►F  F  .  4  .  .  . 

8  9 

14  15 

F  F  . 

.-F„  -Fn 

10  11 

8  9 

13 

E  F,  F,  - 

(F  F  +  F  F  ) 

k=8  k  k+2 

8  14  9  15 

F8  F9  . 

F  F  F 
'••••  13  14  r 15 

F  F  . 

i 

i 

*1 

■  9  10 

12 

8  9  10 

E  F  F 
k=8  k  k+3 

"  ^F8F13+  F9F14 

Method  III  :  Consider  the  following  modification 
of  the  Q-spectrum  as  defined  in  (5): 

Q  a  X  2 

0  0 

Vq  =  <Xk>'m  CB(m-1);,q  (Xk>m  U2) 

2m'1sk<2m  .  0sq<2m"1,  0<m6n. 

For  example  when  N=8,  (12)  yields, 

«o  ■ 

Vo-  «*’ 

2  2 

Q2,0  =  X2  +X3 

Q2,l  =  ° 

Q  =  -Q 

2,2  v2,0 

Q  =  X  2  +  X  2  +  X,2  +  X2 
3,0  4  5  6  7 


°3,1  =  I  {X42 


X  2  +  X.2 


♦  2X5V 


S,2*  °, 


Inspection  of  (13)  shows  that  N=8  yields  5  *  (- 
+1)  independent  Q-spectrun  points  namely  Q  ,  2 

Qi  o»  Qo  o*  Q3  o  *nd  Qa  j  vhich  With  thoSe 

in’?6).2’?n  general ,  (M  yields  (|  ♦  i)  inde¬ 
pendent  Q-spectnm  points  which  are  identical 
to  those  defined  by  (5). 

The  definition  of  the  O-spectrum  in  (12) 
yields  the  following  WHT  at-- correlation  theoram: 


-A  J  ,A  A  A  A  A  . 

{Q(n)}  =  (Q0  Q1>0  02>0  Q2,i*—  Qn,2n-l-l). 
vitn^  t 

=  %’  ^1,0  =  Q1,0 

o  =  2-^m'1^2Q_  for  2<nwn  , 

m,t  nn,t 

0<i<2ro"1-l 

and 

{^(n))  =  (r  rx . rK1)  is  the  autocorre¬ 

lation  vector  whose  elements  are  the  cyclic 
autocorrelation  coefficients  of  the  data  sequenae 
(x(n)).  The  transformation  matrix  [D(n)]  is 
defined  in  (9), 

From  (14)  it  is  clear  that  the  Q-spectrun 
can  be  rapidly  computed  as  follows: 

1.  Compute  r^,  k=0,l,*-*,  (N-l)  using  the 
fast  Fourier  transform  (FFT)  technique. 

2.  Compute  Q_  as  in  (14)  using  the  modified 
WHT  defined  in  (9). 

SUMMARY  OF  COMPUTATIONAL  RESULTS  FOR  THE 
Q-SPECTRUH* 

/ 

Table.  I  repesents  a  s urinary  of  execution 
times  to  compute  the  Q-spectrum  using  Methods 
I-III  discussed  above.  An  IBM  360/50  digital 
computer  was  used. 

I  ( Execution  time  in  minutes 


N 

Method  I 

Method  II 

Method 

32 

<  0.12 

<  0.12 

<  0.12 

64 

<  0.12 

<  0.12 

<  0.12 

128 

0.18 

c  0.12 

<  0.12 

256 

0.42 

<  0.12 

0.18 

512 

1.80 

0.24 

0.36 

024 

7.62 

0.54 

0.78 

Table  1,  Comparison  of  the  execution  times  for 
computation  of  the  Q-spectra. 

From  Table  I  it  follows  that  Method  II  is  the 
most  efficient  with  respect  to  execution  time 
for  the  values  of  H  considered.  Memory  re¬ 
quirements  for  the  three  methods  are  approximate¬ 
ly  the  same.  Also,  Methods  II  which  uses  the 
modified  WHT  has  an  additional  advantage  over 
Method  III  in  that  it  requires  only  real  number 
arithmetic. 

COMPUTATION  OF  THE  J-SPECTRUM 

From  (7)  it  follows  that  the  J -spec trim  is 
obtained  from  the  Q-spectrum  by  means  of  a  lines? 
transformation.  The  general  form  of  the  trans¬ 
form  is  as  follows  [5]  : 

J0  =  Qo 

Ji.ox  Ql,0 

J2,0=  °2,0 


{£  (n)}  =  f  C  D(n)J  (rfn)} 


{Hs>q  * 

CT(s-2)]"1 

<$s>q  <15> 

C 

s  q< 

2s-2 

,  3  <  s  <  n 

where  , 

<dS>q  » 

<Js  ,0 

Js,I 

*•••  ^,23-2-!) 

^q  = 

^8,0 

°S,1 

Q8,28-2-l> 

and  tT(n-2)3  is  a  (2s* 

’2  x  2s-2)  matrix  whose 

q-th  row  is  equal  to  the  upper  half  diongonal  of 
the  [B(s-1)3^  where  [B(s-l)]  is  defined  in  (<*). 

Let  [l(n)3  denote  a  shifted  version  of 
[I(n)3  with  the  all  zeros  in  the  first  column, 
such  that 


o  o  ••••  0  0 

0  0  0  1 

A  oo  ••••  1  0 

CKn)]  = 


0  1  0--0  0 


For  example,  for  N=8,  (16)  yields 


[1(2)3  = 


"o  0  0  o' 
0  0  0  1 
0  0  10 
0  10  0 


Then,  it  can  be  shown  that  the  (Q  }  to  (Jg) 
transformation  can  be  expressed  as  follows: 

J  =  Q„ 

0  0 

J1  =  Ql,0 

J2,0  =  <>2,0 

»s>q  =  ^  C«<3-2)3  (Qs3q  ,  0<q<2s-2, 

3ssSn 

where, [W(s-2)3  has  the  recurrence  relation, 

r-  .  .  .  _ _  A  -i 


[w(k+l)3  = 


|V(k)  I  2W(k)  - 


k)  -  W(k)  I(kf 
k)  -  W(k)"T(k)_  , 


j_W(k)  !  -2W(k)  -  W(k)  Kky, 
k  =  0,  1,  . . . . ,(n-3).  (17) 


economical  feasibility  studies  in  pattern  re¬ 
cognition  problems.  The  WHT  or  BIF0RE  power 
spectrum  [13  which  is  also  a  WHT  spectral  mode 
has  already  found  several  applications  in  the 
general  area  of  pattern  recognition  [2-43. 
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The  recurrence  relation  in  (17)  provides  the  key 
to  an  efficient  algorithm.  For  example,  consider 
N=32.  Then  the  recurrence  relation  is  used  thrice 
with  s=3,4  and  5.  As  an  illustration ,  the  sequ¬ 
ence  of  computations  for  s=5  are  shown  in  Fig.  2. 
Since  [W(s-2)3  is  a  (8x8)  matrix  when  s=5,  there 
are  3  iterations.  In  general,  for  a  given  s, 

35s in  there  are  log2(s-2)  iterations.  From  Fig. 

2  it  follows  that  in  general,  the  number  of  ari¬ 
thmetic  operations  and  storage  locations  re¬ 
quired  is  proportional  to  N,  as  in  the  esse  with 
the  FWHT  and  the  FFT.  In  this  sense,  the  above 
J-spectrum  algorithm  is  optimum.  The  execution 
times  associated  with  this  algorithm  for  various 
values  of  N  are  sianmarized  in  Table  II.  A  360/ 

50  IEM  digital  computer  was  used. 


64 

128 

256 

512. 

1024.. 

018 

0.24 

0.36 

0,6 

1.62 

1  in  minutes  I _ 1  I _ 1 - 1 - 1 - J 

Table  2,  Execution  time  for  computation  of  the 
J-spectrum. 


CONCLUSIONS 


The  methods  presented  in  this  paper  for 
computing  the  WHT  quadratic  and  optimum  quadratic 
spectra  can  be  used  for  the  purposes  of  conducting 
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Iteration  1  Iteration  2  Iteration  3 

Qs  o=Y(0)— >Y(0)+2Y(4)-0  =  Y1(0)— >Y1(0)+2Y1(2)-0  =  Y2(0)— +Y2(0)+Y2(1)  =  Y3(0)-1^fl*J5>0 
Q5tl=Ya)-tY(l)+2Y(5)-Y(7)=Yi(1)— »Yia)+2Y1(3)-Y(3)=Y2(l)— »'Y2(0)-Y2(1)=  YgU)  Jg<1 

Q5>2=y(2)— ,Y(2)+2Y(fi)-Y(6)=Y1(2)— ^Y1<2)-2Y1(2)-°  =Y2<2> — »Y2(2)+Y2(3)=  Y3(2)  ? 

Q5  3=Y(3)-»Y(3)+2Y(7)-Y(4)=Y1(3)-»'Y1(3)-2YJL(3)-Yi(3)=Y2(3)-tY2(2)-Y2(3)=Y3(3)  J/g»  J5  3 

Q5j4=Y(4)-4Y(0)-2Y(4)-0=Y1(4) - >  Y1(4)+2Y1(6)-0  1  s  Y2(4)— ->Y2 ( 4 )-hY2( 5 )=Yg (4 )  — U&+  K 

Qs  S=Y(5) — ?Y(1)-2Y(5)-Y('7)=Y1(5)->Y1(5)+2Y1(7)-Y1(7)=Y2(5)-<.Y2(4)-Y2(6)=Y3(5)  J5  g 

Q5  >g-Y(6)  >Y(2)-;’Y(6)-Y(6)=Yi(6) — »Yj(4)-2YjL(6)-0  =Y2(6)_>Y2(6)+Y2C7)=Y3(6)  1J8+ 

Q5t7=Y(7)— »Y(3)-2Y(7)-Y(5)=Y1(7)->Y1(5)-2Y1(7)-Y1(7)=Y2(7)->Y2(6)-Y2(7)=Y3(7)  1 ? 
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Abstract 

Searle's  Logical  Walsh  Transform,  presented  in  1970,  is  investigated  in 
detail  for  sequences  of  longer  length  than  the  k-bit  sequrnces  (N  *  1») 
considered  by  Searle.  This  transform  is  attractive  for  processing  binary 
data  because,  unlike  the  conventional  Walsh  transform,  a  logical  transform 
contains  no  more  bits  than  the  original  signal.  The  original  goal  of  the 
investigation  vas  the  discovery  of  a  fast  Boolean  algorithm  for  this  trans¬ 
form  which  would  require  little  intermediate  storage.  In  searching  for 
properties  of  the  transform  on  which  such  an  algorithm  might  be  bared, 
however,  it  vas  found  that  very  simple  properties  sad  relationships  which 
hold  for  N  «  k  become  messy  and  complex  for  sequences  of  longer  length.  In 
fact,  transform  reversibility  even  breaks  down  for  N  ^  16.  A  detailed  analy¬ 
sis  of  the  behavior  and  reasons  for  the  breakdown  is  presented,  including  a 
simple  rule  for  determining  the  "singular  points"  of  the  transform. 


Introduction 

Searle  (1970)  introduced  a  "logical"  Walsh 
transform,  vhich  elimluates  redundancy  result¬ 
ing  from  the  application  of  the  conventional 
Walsh  traraform  to  binary  data.  In  the  general 
case.  If  the  input  data  to  the  conventional 
Walsh  transform  have  a  dynamic  range  D,  the 
transform  coefficients  that  are  the  output  data 
have  a  dynamic  range  of  ND,  where  N  is  the 
"length"  of  the  transform  (i.e.,  the  number  of 
data  points  input  to  the  transform).  Original 
data  that  are  quantised  to  m  bits  oer  date 
point  will  require  mN  bits  per  data  poi;.t  for 
complete  representation  in  the  transform  domain. 


Searle  noted  that  if  a  binary  data  string 
(m  «  1)  of  length  N  ■  k  were  input  to  the  Walsh 
transform,  and  if  the  first  bit  is  1,  only  the 
sign  bits  of  the  transform  output  are  necessary 
to  completely  restore  the  original  binary  data. 
Furthermore,  it  turned  out  that  these  sign  bits 
need  only  be  input  to  the  Walsh  transform  and 
the  sign  bits  of  the  output  data  were  identical 
to  the  original  binary  data.  The  set  of 
ordered  sign  bits  is  called  the  logical  Walsh 


transform.  The  integer  x  corresponds  to  the 
set  of  H  input  aata  {xj ,  x2,  ...,  x_)  accord¬ 
ing  to  N  H 

*  —  —  r  _  o*'  1 


while  the  integer  X  corresponds  to  the  bits  of 
the  logical  transform  (Xj,  \2»  •••>  Xj^ 


These  bits  (X^)  are  defined  by  the  operation 
of  thresholding: 

Xk  *  1  if  ill  *i  ~.i>  *  *k  (X>  ”  0  (1) 

xk  *  0  if  xt  WAL  (k.i)  •  Wj.  (x)  <  0 

where  WAL  (k,i)  is  the  kth  Walsh  function  in 
the  Kronecker  or  periodicity  (Parkyn,  1970) 
ordering,  that  of  the  fast  Welsh  transform 
algorithm.  The  convention  that  0  in  the  Walsh 
transform  is  associated  with  the  negative 
rather  than  the  positive  integers  may  at  first 
appear  arbitrary.  Under  the  convention  that 
the  first  bit  of  the  sequence  is  1,  this  asso¬ 
ciation  is  necessary  for  transform  invertibil- 
ity.  In  fact,  the  transform  is  its  own  inverse 

LWAL  [LWAL  (x)]  »  LWAL  (X)  «  x. 

Searle  suggested  that  the  transform  be  extended 
to  binary  sequences  starting  with  a  0  bit  by  a 
complementation  procedure.  For  0  <_  x  <_  2""1  -1 
define 

LWAI-  (x)  s  %, 

where  X  *  LWAL  (3c) .  The  caret  (" )  it  used  to 
denote  the  complementation  mapping  x+vc^-l  -x). 

In  the  rest  of  this  paper,  hexadecimal  (base 
16)  numerals  will  often  be  used  for  conven¬ 
ience.  Table  1  gives  these  U’werals ,  their 
binary  representation,  the  k-bit  logical  trans¬ 
form,  and  the  modulo-2  sum  of  each  cumber  end 
its  logical  transform. 


Chi s  work  was  sponsored  by  the  A.'r  Force  Office 
of  Scientific  Research  (Air  Force  Systems 
Command)  under  Contract  Fkk620-71-C-0052. 
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X 

o 

1 

2  0  0  1  0  1*  6 

3  0  0  1  1  5  6 

4  0  1  0  0  2  6 

5  0  10  1  3  6 

6  0  1  1  0  6  0 

7  0  111  0  7 

8  1  0  0  0  F  7 

9  10  0  1  9  0 

A  10  10  C  6 

B  10  11  D  6 

C  110  0  A  6 

D  110  1  3  6 

E  1110  E  0 

F  1111  8  7 

When  this  Investigation  began,  it  vas  hoped 
that  this  transform  vould  have  broad  applica¬ 
tion  in  binary  image  processing.  First  a  fast 
algorithm  vas  needed.  This  is  the  subject  of 
Section  1.  This  search  soon  revealed  that  the 
transform  has  hidden  complexity:  its  "neat" 
behavior  for  N*4  becomes  "messy"  with  H«8,  and 
vith  H«l6,  reversibility  is  no  longer  complete. 
Section  2  gives  the  results  of  vork  on  on 
exhaustive  enumeration  of  the  S»l6  case  (32,768 
integers).  It  vas  discovered  that  896  special 
numbers,  here  called  seed  integers,  act  as 
singular  points  of  the  logical  Walsh  transform. 
Section  3  analyz.es  these  Integers  and  gives  the 
reasons  for  their  number  and  distribution. 

Thus  instead  of  a  nice  easy-to-use  transform, 
ve  have  some  very  Interesting  and  totally 
unexpected  complexities. 


Section  1  A  Fast 


norlthmt 


The  conventional  fast  Walsh  transform  algo¬ 
rithm  operates  only  on  lengths  that  are  povers 
of  2,  vLile  calculation  of  the  Walsh  transform 
for  other  lengths  requires  multiplication  by 
the  appropriate  Hadsmard  matrix  (this  "slew" 
vay  uses  N2  scalar  multiplications,  versus 
H  log2N  the  "fast"  vay).  Either  vay  increases 
the  storage  requirement  to  N  bits  per  input 
data  point.  What  is  desired  is  an  algorithm 
that  only  requires  1  bit  per  input  data  point 
(i.e.,  a  "Boolean"  algorithm),  vith  only 
moderate  intermediate  storage,  Moreover,  prac¬ 
tical  use  of  the  logical  transform,  such  as  for 
binary  images,  requires  such  an  algorithm  to  be 
fast  (i.e.,  required  operations  per  data  point 
proportional  to  log2H  rather  than  It). 


It  vas  originally  hoped  that  soma  simple 
patterns  in  the  behavior  of  the  logical  trans¬ 
form  vould  provide  hints  for  the  search  for  a 
fast  algorithm.  For  example,  the  Boolean 
function  xtX  (•  is  addition  modulo-2)  is  shewn 


in  Table  1.  If  this  simplicity  occurs  in  the 
8-bit  case,  it  should  be  looked  at  more  close¬ 
ly.  Table  2  gives  the  complete  8-bit  case,  and 
patterns  in  the  function  x*X  are  more  complex 
than  in  the  4-bit  case. 

Table  2 

Hexadecimal  Logical  Walsh  Transform 
For  8-Blt  Case 
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X 
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Another  pmttern  does  stay  simple  ir  the  8- 
bit  ease:  the  distribution  of  integers  that 
we  their  own  transforms.  There  are  2  in  the 
>it  case,  8  in  the  8-bit  case  (boxed  in 
Taole  2),  but  8U  in  the  16-bit  ease.  These 
last  are  given  in  Table  3,  arranged  to  shov 
symmetries.  Again  there  is  increasing  com¬ 
plexity  when  transform  length  is  doubled. 


Table  3 


CE33EBSBBEE1 

807F 

FF80 

9009 

EFF6 

870F 

F0FO 

911E 

EEE1 

821(1 

FDBE 

92**9 

EDB6 

81(21 

FBDE 

91*29 

E8D6 

8356 

FCA9 

9333 

ECCC 

8536 

FAC9 

935K 

ECAO 

8661 

F99E 

953F 

EACO 

8777 

F888 

9555 

EAAA 

9781 

ES?E 

9871 

E73E 

9796 

E869 

9976 

E689 

9990 

E66F 

9BD0 

Bl*2F 

9DB0 

E2l*F 

9BD1 

EU2E 

9DB1 

E2hE 

9FF1 

EOOE 

•wOwesMaaeN 


Al*l(D 

DBB2 

B58C 

CA73 

A55E 

DAA1 

B85C 

C7A3 

A581* 

DA7B 

B58D 

CA72 

A85I* 

D7AB 

B85D 

C7A2 

A7Cl* 

D83B 

B7CD 

C632 

AC7H 

D38B 

BC7D 

C382 

-  '05 

D83A 

BCCC 

C33? 

AC75 

D38A 

BDDl* 

C22B 

A  more  direct  search  for  a  Boolean  function 
utilizes  the  Quine  algorithm  (Harrison,  1965). 
The  2h  possible  N-bit  integers  map  onto  the 
vertices  of  the  unit  hyper  cube  in  the  vector 
space  of  N  dimensions,  which  is  where  the  Walsh 
transform  operates.  Each  of  the  N  bitsXk  of 
the  logical  transform  Is  treated  as  a  separate 
Boolean  function  XfcX-)  and  its  value.  0  or  1, 
is  put  on  all  the  2"  vertices.  All  those  hav¬ 
ing  the  value  1  are  connected,  and  if  the 
resultant  figure  is  appropriately  simple,  we 
can  expect  to  find  a  Boolean  algorithm.  The 
l:-bit  case  is  shown  in  Figure  1,  which  givec 
the  functions  X2(x),  X3W,  Xj,U).  Here 
the  resultant  figures  consist  of  3  mutually 
perpendicul or  planes  Intersecting  in  a  line. 
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.0111 


1110^ 


UCKT 


0110  1011 


W2(x)  -  1 


1111 

/ 

/ 


/>1U  v 
/  \1000 


/ 


mop.  on®  - ^xixi 

1101* 

1010' 

ll.TOv  OlCSj 


1000 


Wj(x)  »  1 


0000 


Figure  1  Quine  Algorithm  For  K»l* 
Logical  Walrh  Transform 
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But  in  the  6-bit  case,  we  do  uot  find  such 
simple  patterns  as,  for  example ,  7  six-dimin- 
sional  hyperplaaes  inter-ecting  in  a  line  or 
even  in  a  plane,  but  15  three-dimensional  and 
6  four-dimensional  hyperplanes,  all  unconnect¬ 
ed.  A^nin,  doubling  the  transform  length 
Makes  a  simple  pattern  becooe  messy,  further 
clouding  the  search  for  a  fast  algorithm. 

When  the  breakdown  of  transform  invertibility 
was  discover sd  for  the  H«16  oaae,  a  fast  algo¬ 
rithm  ves  no  longer  of  conce-n;  an  irreversi¬ 
ble  transfer*  destroys  information  and  so  has 
little  chance  of  practical  application. 

Section  2 

Besults  From  K°l6  Enumeration 

After  the  efforts  describe!  in  the  preced¬ 
ing  section,  it  was  decided  to  print  out  by 
computer  thj  logical  transform  function  for 
the  entire  set  of  16-Mt  integers  (D1'**  32,763 
Hi  216-1  ■  65,53'.)K  This  did  not  require 
an  excessive  amount  of0ccmputer  printout,  un¬ 
like  the  K-32  cla-s  (2^  *  2,lk7.k83,6k8  inte¬ 
gers).  Direct  visual  inspection  immediately 
proved  fruitful:  (l)  the  logical,  transform  is 
no  longer  reversible;  (2)  the  irreversibility 
takes  the  5'orm  of  many- to-one  mappings,  where¬ 
by  a  set.  of  16  integer*  all  have  the  same  logi¬ 
cal  transform;  (3)  there  tre  696  such  sets  of 
j.6  integers-,  for  only  one  of  which  ie  the  log¬ 
ical  tiansform  reversible;  (k)  there  are  896 
such  special  integers,  paired  by  the  logical 
transform  function;  (5)  thn  other  15  members 
of  each  set  are  derived  from  the  special  inte¬ 
gers  by  altering  any  one  of  its  bits  except 
the  f irr.t .  Because  of  this  property ,  thsio 
896  numbers  ere  called  "seed  integers".  Eote 
that  there  are  not  2C(8  seed  Integers,  which 
vouxd  encompass  the  entire  S«l6  case,  oz  even 
102k,  bus  396  *  160Cq.  The  reason  for  this  is 
set  out  in  detail  in  Section  3,  and  it* 
essense  lie*  iu  the  Welch  transform  threshold¬ 
ing  procedure  (1),  The  15  derivative  integers 
that  are  generated  trrt  each  seed  lute gar  all 
have  the  same  logical  transform  x.  Since  they 
differ  iTcx  the  seed  integer  by  oni^  otv  bit, 
the  Walsh  transform  coefficient*  V\_  each 
differ  from  the  tforveoponding  coefficients  of 
tb*  aeed  Integer  by  +1,  while  the  correspond¬ 
ing  logical  transform  bits  are  the  same. 

Thus  it  must  b*»  that  the  Walsh  treasfora  co¬ 
efficients  of  t‘ie  tied  integer  are  iuch  that 
»  change  of  *!  or  -1  will  not  make  it  cross 
the  threshold  -  i.e.,  go  frsm  0  to  1  or  1  to  a 
Obviously  this  is  possible  only  if 

Vk  *  3,1  %  -  2 . 13  (2) 

This  set  of  15  restriction*  entirely  deter¬ 
mines  the  number  and  values  of  the  seed,  inte¬ 
gers,  as  v«  will  show  in  Section  3. 

At  the  beginning,  however,  the  896  sowd 
integers  were  merely  called  out  by  computer 
and  printed  out  lr  112  rows  of  8,  whence  iC 
wee  quickly  determined  that  they  readily  f«ll 
J.ct.o  lk  eete  of  •-  rove  each.  When  these  8 
rows  of  3  seed  integers  each  are  put  in  hexa¬ 
decimal  notation,  the  first  two  bytes  of  each 
row  aro  the  tame,  while  the  last  two  byten  of 


each  "column”  are  the  same.  Thus  to  list  all 
tha  seed  integers,  we  need  only  list  the  8 
bytr-paira  of  each  row  and  the  8  byte-pairs  of 
each  column.  The  6k  possible  combinations  are 
the  teed  integers.  Theso  lk  sets  of  byte- 
pairs  are  given  in  Table  k,  where  a  rich  struc¬ 
ture  of  reciprocities  and  correspondences  is 
readily  apparent. 

Table  k 

The  Seed  Integers 
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Other  relationships  between  the  eeed  inte¬ 
gers  become  visible  when  they  are  plotted  on  a 
graph,  with  the  first  two  bytes  on  the  ordi¬ 
nate,  the  second  two  ca  the  abscissa.  Fijure  2 
shove  the  result  for  one  quaurant  of  the  graph 
(the  ether  quadrants  are  merely  reflections  of 
this  one).  Instead  of  a  random  scatter,  28 
seth  of  b  integers  each  form  variously  shaped 
octagon*.  The  straight  1J.‘  es  may  be  seen  as 
octagons  viewed  on  edge. 
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Permutation  Groups  of  WciKht-o  and  Weight-11 
Seed  Integers  Paired  by  the  Logical  Transform 
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FIRST  BYTE-PAIR 

One  more  pattern  of  classifying  seed  inte¬ 
gers  will  be  presented  to  give  .1  transition  to 
Section  3.  The  weight  of  an  integer  Is  defined 
as  the  number  of  1-bits  in  its  binary  represen¬ 
tation.  Seed  integers  fall  into  four  weight 
classes:  168  with  weight  6,  280  with  weight  7, 
280  with  weight  10,  168  with  weight  11.  The 
weight  -7  and  weight  -10  classes  are  closed 
with  respect  to  the  logical  transform.  Each 
weight  class  can  be  further  subdivided  into 
"permutation  sets",  which  are  sets  of  seed 
Integers  having  the  same  numerals,  in  differ¬ 
ent  orderings,  for  the  second,  third,  and 
fo-trth  bytes  of  their  hexadecimal  representa¬ 
tion.  Each  group  may  hare  1,  3,  or  6  members, 
depending  on  what  the  numerals  are.  The  logi¬ 
cal  Valsh  transform  maps  an  entire  group  onto 
another.  Table  5  gives  the  permutation  groups 
of  tne  ’.'eight  -6  seed  integers,  paired  with 
the  corresponding  weight  -11  group  by  the  logi¬ 
cal  transform.  Within  a  group,  exchanging  the 
second  and  third  bytes  causes  the  logical 
transform  to  exchange  its  third  and  fourth 
bytes.  For  example,  812B  is  the  logical  trans¬ 
form  of  063F  (and  vise  versa).  Then  821B  is 
the  transform  of  D6F3,  and  81B2  is  the  trans¬ 
form  0'  035? . 

Table  6  gives  the  group*  for  weight  -7,  and 
Table  7  the  groups  for  weight  -10  seed  inte¬ 
gers.  Within  these  groups,  exchanging  the 
second  and  third  byte*  of  a  seed  integer  does 
the  sane  to  the  logical  transform,  while  ex¬ 
changing  the  second  and  fourth  causes  the  third 
and  fourth  bytes  of  the  logical  transform  to  be 
exchanged. 


One-Mcaber  Groups 
BUU  :  VDLP 
D222  :  CBR2 
Eli',  •  9  SEE 
Three-Member  Groups 
8711  •  97E7 
8722  :  C7B7 


Six-Member  Groups 


812B  :  D63F 


8ll»D  :  BfiSF 
8l8E  :  F71E 
82lt?  :  E35? 
828D  :  F?UB 
gi»8b  :  rrsr> 
9035  :  9D7B 
903A  :  D93F 
905C  :  B95F 
90AC  :  FD1B 
A036  •  CD7E 
A039  :  DC6F 
A06C  :  EC5F 
A09C  :  FDl*E 
C056  :  AB7E 
C059  ;  BA6P 
C0A6  :  E3AF 
C0A9  :  F2BE 
B128  :  DC9? 
011:8  :  BA9F 
E2l)8  :  EACF 


Table  6 


Permutation  Groups  of  Weight -7  Seed  Integers 
Paired  by  the  Logical  Transform 


One-Member  Group 
F836  :  F88B 
Three-Member  Groups 


922E  :  CUB 
9fel*E  :  A110 
988E  :  F1I8 
A22D  :  CAl»B 
AbltD  :  AlthD 
A88E  :  F  1)1)8 
C22B  :  C22B 
C88B  :  F228 
Six -Member  Grou 
8356  :  8356 
8359  :  921)7 
836A  :  C217 
839A  :  D306 


8C56  :  A17l) 
8C59  :  BO65 
8C6A  :  E035 
8C9A  :  F12U 
9781  :  9781 
912D  :  9**1B 
928B  :  D309 
9**8d  s  B509 
B06A  :  C81D 
B09A  :  D90C 
C28E  :  E30A 
ECAO  :  ECAO 
A12E  :  CklE 
A18B  :  D60C 
A2l)B  :  C24D 
A278  :  C8!)7 
Al)8E  :  E50C 


Permutation  Groups  of  the  Welght-10  Seed 
Integers  Paired  by  the  Logical  Transform 


One-Member  Group 
8777  :  3777 
Three-Membar  Crouoa 
8BB7  :  D772 
8DD7  :  D772 
8EE7  :  E771 
BBBb  :  DDD2 
BDDb  :  BDDb 


DBB2  :  DBB2 
DEE2  :  EBB1 
EEE1  :  EEE1 
Six-Member  Groupa 
8BDE  :  P356 
B8DE  :  F05C 
E88D  :  FA6C 
D8BE  :  F93A 


B78B  :  D78D 
B1BE  :  DD1E 
B2BD  :  DBbB 
E2DE  :  EBbE 
935F  :  935F 
9C5F  :  B17D 
C95F  :  B27E 
93AF  :  D71B 
A39F  :  D7bE 
AC9F  :  F56C 
9CAF  :  F539 
C9AF  :  F63A 
A36F  :  C65F 
AC6F  :  Eb7D 
CA6F  :  E27B 
E78E  :  E78E 
FCA9  :  FCA9 


Section  3 


Analysis  of  the  Seed  Integers 


In  this  section  we  will  show  how  the  defin¬ 
ing  property  of  a  seed  Integer,  given  by  (2), 
generates  the  configurations  of  Tables  5,  6, 
and  7. 


Ke  will  give  an  analytic  enumeration  of  all 
the  possible  bit-configurations.  But  first 
there  are  two  equivalences  which  reduce  the 
amount  of  enumeration.  These  are  partial  and 
full  complementation.  Complementation  changes 
1-bitr  to  0  and  O-bits  to  1.  It  is  partial 
If  the  first  1-blt  is  unchanged.  We  will  prove 
that  the  partial  and  full  complements  of  a  seed 
integer  also  fulfill  (2). 


For  partial  complementation,  take  the  Walsh 
transform  vectors  of  an  integer  x  and  of  Its 
partial  complement  x.  Their  vector  sum  has  the 

fora  W(x)  ♦  W(x)  -  17,1,1,. ...1 

Thus  If  W(x)  does  not  equal  0  or  1,  neither 
does  W(x).  Thus  It  is  only  necessary  to  enu¬ 
merate  the  integers  with  an  even  number  of  1- 
blts,  and  their  partial  complements  vill  cover 
the  entirety  of  the  integers  with  an  odd  number 
of  1-bits.  When  a  seed  integer  has  an  even  num¬ 
ber  of  1-bits,  its  full  complement  fulfills  (2), 
as  we  see  from  forming  the  vector  sum 

W(x)  ♦  W($)  «  16,0,0,...,0 

If  W(x)  consists  entirely  of  even  nor  iero 
integers,  so  does  W (*).  Thus  we  ne- d  only 
cheek  Integers  with  2,  b,  6,  or  8  x-bits,  with 
the  previous  restriction  of  Xj»  1  removed,  and 
all  the  other  bit  configurations  are  generated 
by  partial  or  full  complementation. 


Weight  2  If  both  1-bits  are  in  the  tirst  half 
of  the  binary  number,  or  both  in  the  second 
half,  there  will  be  b  Walsh  coefficients  that 
zero  out  because  the  two  1-bits  are  weighted  by 
+1  and  -1.  If  there  is  one  in  each  half,  then 
WQ(x)  ■  0.  We  will  call  these  reasons  Rule  A 
and  Rule  B,  respectively. 

Weight  it  If  all  b  1-bits  are  in  either  half  of 
the  binary  number,  Rule  A  applies.  If  there 
are  2  1-bits  in  either  half.  Rule  B  applies. 

If  ”e  divide  the  bit-configuration  into  four 
quarters  and  designate  a  configuration  by  their 
weights,  the  remaining  veight-b  cases  are 
(2, 1,1,0),  12,1,0,1),  (1,0, 2,1),  (1, 0,1,2), 
(0,1, 2,1)  and  (0,1, 1,2)  (collectively  designat¬ 
ed  by  (2, 1,1,0])  and  (3,0,1,0),  (0,3, 1,0), 

(3, 0,0,1),  (0, 3,1,0),  (1,0, 3,0), (0,1, 3,0), 

(1,0, 0,3),  and  (o,l,0,3)  (collectively  desig¬ 
nated  by  [3, 1,0,0)).  The  cases  [2, 1,1,0)  art 
eliminated  by  at  least  one  Walsh  coefficient 
for  which  the  weight-2  quarter  contributes  zero 
and  the  other  two  weight-1  quarters  contribute 
+1  and  -1,  for  a  zero  total.  This  is  called 
Rule  C.  The  cases  [3,l,0,o]  are  eliminated  by 
at  least  one  Walsh  coefficient  for  which  the 
weight-3  quarter  contributes  ±1,  and  the 
weight-1  quarter  contributes'”!. 

Weight  8  ■  Rule  A  eliminates  all  integers  with 
the  8  1-bits  in  either  half  of  the  binary 
number.  Rule  B  eliminates  all  those  with  b 
1-bits  In  both  halves.  Rule  C  eliminates  the 
cases  [b,3,l,0],  [b,2,2,0)  and  [3,2, 2,1).  That 
is,  ther,  is  at  least  one  Walsh  coefficient 
that  zeros  out  the  even  weight  quarters,  and 
cancels  the  remaining  two  odd-weight  quarters. 
For  the  cases  [li, 2,1,1]  and  [3,3,2,o]  at  least 
two  of  the  even  Walsh  coefficients  are  zero. 

In  [b,2,l,l],  the  veight-b  and  weight-2  quar¬ 
ters  will  zero  cut  and  the  two  welght-1  quar¬ 
ters  will  make  opposite  contributions.  Simi¬ 
larly,  in  [3, 3,2,0)  the  two  weight-3  quarters 
will  make  opposite  contributions  and  the 
weight-2  quarter  will  zero  out.  This  is  RuleD. 

Weight  6  Rule  A  eliminates  all  integers  with 
the  6  1-bits  in  either  half.  Rule  B  eliminates 
all  th">se  with  3  1-bits  in  both  halves.  RuleC 
eliminates  the  cases  [3, 2, 1,0]  and  [b, 1,1,0). 
This  leaves  the  cases  (2,2,2,0)  and  f3,l, l»l) 
some  of  which  can  be  seed  integers.  Ffom  these 
all  the  seed  integers  car  be  derived. 

First  the  simpler  case,  [2, 2, 2,0).  Each 
quarter  has  a  b-eo«ponent  Walsh  transform 
vector:  W(L^)  «  (vi,v2,v2tvk) ,  where  each 

component  weights  the  b  hits  of  hi  accordingly: 
VJ,  4444;  w2,  4-4-;  V3,  ++ — ;  vj,,  4~4.  Table 
8  gives  the  veight-2  hexadeci’ual  numerals, 
paired  by  complementation,  their  bit-coni iguru- 
tlons,  and  their  length-b  Walsh  transform  co¬ 
efficients.  Nov  the  length-16  Walsh  transform 
is  formed  by  the  concatenation  four  b-component 
vectors,  each  of  vhich  is  a  combination  of  the 
length-b  Walsh  transforms  of  the  four  quarters 
of  x: 

W(x)  -  (Vdi)  +  V(l2)  +  W(L3)  4  W(L(,); 

W(L,)  -  W(lo)  4  vU3)  -  W(i.h); 

WUO  +  Vtl^)  -  WU3)  -  WUj,):  (3) 
v(l:;)  -  wfLg)  -  v(l3)  4  wUj,)). 
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5  0101  2  -2  00 

A  1010  2200 

6  0110  200  -2 

9  1001  2002 


Applying  this  to  Table  8,  ve  see  that  for 
the  coefficients  W«-(x),  Wg(x),  W^qU), 

WlU(x)  to  he  non-zero,  ve  must  have  either 
5  or  A  and  not  both,  in  one  of  the  quarters. 
For  the  coefficients  W-j(x) ,  Wj(x) ,  W^(x), 
Wis(x)  to  be  non-zero,  ve  must  have  either 
3  or  C,  and  not  both,  in  another  of  the  quar¬ 
ters.  Finally,  for  the  coefficients  Wi,{x), 
Wg(x),  W12(x),  W13(x),  either  6  or  9,  not 
both,  in  the  other  veight-2  quarter.  The 
total  nunber  of  integers  satisfying  these 
conditions  is  calculated  as  follovs:  the 
zero  may  go  in  an,'.'  of  the  U  quarters,  any  of 
the  5  velght-2  numerals  may  go  in  another 
quarter,  any  of  the  U  remaining  in  the  next 
quarter,  and  either  of  the  last  2  in  the 
fxnal  quarter;  U - 6 - h-r  =*  192.  Under  the  con¬ 
straint  x  «1,  the  total  is  «  72. 

These  fall  into  the  168  veight-6  seed  inte¬ 
gers  of  Table  5.  Their  partial  complements 
fall  into  the  168  veight-ll  seed  integers  of 
Table  5.  The  remaining  192-72  ■  120  integers 
vith  Xj»0  are  fully  complemented,  and  fall 
into  the  280  veight-10  seed  integers  of 
Table  7.  These  120  veight-7  seed  integers 
are  in  turn  partially  complemented  and  placed 
vith  the  280  veight-7  seed  integers  of  Table 
6. 


(t, 0,0,0)  gives  WjjCx)  *  0  for  some  k.  Thus  the 
bit  configuration  vith  tj*  t , ,  t^«  ti  generates 
seed  integers  and  t^"  tj,  tj.#  t^cannot.  These 
seed  integers  enumerate  as  follovs:  the  vcight 
-3  quarter  may  be  in  any  of  places,  sad  may 
be  any  of  I*  numerals;  this  numeral  determines 
the  numeral  of  the  same  type,  vhich  may  be  in 
any  of  3  places;  the  remaining  tvo  quarters  are 
the  same,  and  may  be  occupied  by  any  of  the  3 
remaining  veight-1  numerals.  When  all  three 
veight-l  quarters  are  the  same,  there  are  16 
core  combinations .  The  total  is  l*.l*>3'3  ♦  l*.l* 

»  lGO.  Under  the  constraint  xy  ■*  1,  the  total 
is  3-10  +  3'1*  +  3*6  *  60.  These  fall  into  the 
166  veight-6  seed  integers  of  Table  5,  vhile 
their  partial  complements  fall  into  the  166 
veight-ll  seed  integers  of  Table  5.  The  re¬ 
maining  160-60  “  100  vith  *  0  are  fully  com¬ 
plemented  and  included  in  the  260  veight-10 
seed  integers  of  Table  7.  These  100  veight-10 
seed  integers  are  in  turn  partially  complement¬ 
ed  and  included  in  the  280  veight-7  seed  inte¬ 
gers  of  Table  7. 


Weight-1  and  Weight-3  Hexadecimal  numerals 


X1  X2  X3  Xk 
0  0  0  1 
1110 


W1  V2  V3  V'- 
1-1-1  1 


3  11-1 


2  0010  11  -1  -1 

D  1101  3-111 


h  0100  1-11-1 

E  1011  31-11 


8  1000  1111 

7  0  111  3  -1  -1  -1 


Next  the  more  complex  [3, 1,1,1]  case. 

Table  9  gives  the  veight-l  and  veight-3  hexa¬ 
decimal  numerals,  paired  by  complementation, 
their  bit  configuration,  and  their  iength-U 
Walsh  transforms.  The  members  of  each  pair 
are  designated  by  type  ti  according  to  the 
bit-position  vhere  the  1  or  0  is  placed.  The 
subscript  i  indicates  vhich  of  the  four  quar¬ 
ters  of  x  the  particular  numeral  is  placed. 
There  are  tvo  different  possibilities:  tvo 
quarters  have  the  same  type,  or  have  differ¬ 
ent  types.  For  the  former,  assume  one  of 
these  quarters  is  the  velght-2  quarter. 

Then  in  (3),  the  contribution  of  this  pair 
to  W(x)  is  ('*,0,0,0)  vhen  their  length-1* 

Walsh  coefficients  W(hj)  and  v(L«)  are  added, 
and  it  is  (i2,  ±2,  12,  12)  vhen  they  are  sub¬ 
tracted.  Nov  look  at  the  remaining  tvo  quar¬ 
ters,  Lj.  and  Lt,  both  of  veight  1.  When  ty* 
tj,  then  contributions  to  W(x)  are 
(12,  12,  12,  12)  vhen  added  and  (0  0,0,0) 
vhen  subtracted.  Thus  the  lt-eomponent  vec¬ 
tors  concatenated  into  V(x)  all  have  the  form 
(6  or  1*,  i.2,  12,  12)  or  (12,  12,  12,  12),  so 
that  Wk(x))*  0  for  all  k,  Hovever,  vhen 
t^  tj,  their  contributions  to  W(x)  contain 
at  least  one  0,  and  vhen  combined  vith 


Finally,  ve  examine  the  case  [3,l,l,l]  bit 
configurations  vith  the  initial  constraint  of 
ti  j  t, .  We  already  kncrv  that  t.  /  tj,  since 
the  t]j  ■  t*  case  is  the  mirror  of  t^  *  t«, 
tjj  i  tt  vhich  as  ve  have  shown  above  fails  to 
produce  seed  integers.  Thus  all  four  quarters 
are  of  different  type.  Consider  the  Walsh  co¬ 
efficients  Wj(x),  Vq(x),  Wi3(x).  Applying  (3) 
to  Table  9,  ve  aee  that  these  coefficients  all 
have  the  values  ±{ (3  +  1)  -  (l  ♦  1))  "12.  All 
the  other  coefficients  (except  of  course  for 
W,(x))  have  the  form  1(1  +  1  +  1  -  l)  *  12. 

Thus  W  (x)  f  0  for  all  k.  These  enumerate  as 
follovs:  the  veight-3  quarter  may  he  any  one 
of  1*  numerals,  placed  in  any  one  of  •*  places; 
the  remaining  veight-l  quarters  are  selected  in 
3* 2*1  possible  combinations.  The  total  is 
U-U-3-2  v  96.  Under  the  constraint  x^  ■  1,  the 
total  is  3.3.2  +  3.3*2  »  36.  These  and  their 
partial  complements  fall  into  Table  5,  for  a 
grand  total  of  72  +  60  ♦  36  *  168.  The  re¬ 
maining  96-36  ■  60  vith  x1  »  0  are  fully  com¬ 
plemented,  then  partially  complemented,  to 
complete  the  enumeration  of  the  veight-10  and 
veight-7  seed  integers,  respectively.  Their 
grand  total  is  120  ♦  100  *  60  «  280,  vhich 
agrees  vith  the  computerized  enumeration. 
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Conclusion 

The  last  sactiou  shoved  haw  the  U-bit  Walsh 
transform  cones  into  the  determination  of  the 
seed  integers.  Thus  the  seeming  simplicity  of 
the  5“l»  case  actually  contributes  to  the  coa- 
plexlty  of  the  K«l6  case.  That  is,  the  pro¬ 
perties  of  the  b-blt  case  are  the  reasons 
there  are  only  89 6  seed  integers,  instead  of  a 
much  "neater"  102!*  or  201*8.  Thus  as  transform 
reversibility  breaks  dovn,  it  does  so  in  a  co¬ 
herent  manner,  but  vith  gaps,  so  to  speak,  in 
the  coherence:  the  blank  squares  in  Figure  2 
attest  to  this.  This  fits  right  in  with  the 
results  of  Section  1,  which  showed  that  doubl¬ 
ing  the  transform  length  greatly  Increases  the 
"messiness"  of  the  transform.  A  randcn  samp¬ 
ling  of  the  N«3 2  case  shows  a  continuation  of 
this  trend:  a  high  percentage  of  the  integers 
are  irreversible,  and  the  transform  can  be 
done  many  times  without  it  "settling  down"  to 
a  reversible  integer.  Furthermore,  the  analy¬ 
sis  derivation  of  seed  integers  is  beset  with 
difficulties:  (1)  there  are  31  simultaneous 
inequalities,  (2)  sometimes  more  than  one  bit 
can  be  varied  without  changing  the  logical 
transform. 

Besides  the  H“32  case,  research  can  be  con¬ 
tinued  in  other  directions:  (l)  defining  a 
logical  transform  for  Hadamtrd  matrices  other 
than  2n;  (2)  defining  other  transforms  by 
altering  the  geometry  of  Figure  2  (remember 
that  the  analysis  of  Section  3  gives  no  reason 
for  these  octagons);  (3)  using  a  different 
procedure  to  derive  X  from  W  ,  in  an  attempt 
to  restore  reversibility.  While  only  the  last 
proposal  can  have  any  practical  application  in 
binary  data  processing,  the  other  two  are  of 
general  interest  in  Walsb-function  research  and 
Boolean  algebra.  The  increasing  "messiness" 
of  the  logical  transform  may  have  interest  in 
the  philosophy  of  mathematics,  which  is  usually 
occupied  with  "well-behaved"  phenomena. 
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Function  representation  by  Walsh  series 
is  «  profitable  excercise  only  wben  it  is 
both  accurate  and  economical.  By  accuracy  we 
men n  that  the  series  must  satisfy  some  error 
criterion.  If  the  function  being  represented 
is  a  random  signal  the  accuracy  is  usually 
measured  by  the  mean  square  deviation  while 
numerical  applications  would  require  that 
the  maximum  absolute  error  be  below  some 
upper  limit.  Economy  demands  that  the  Walsh 
series  contains  less  terms  than  the  amount 
of  data  necessary  to  specify  the  original 
lunction.  Thus  the  amount  of  information 
contained  in  the  original  function  is  compr¬ 
essed  into  a  smaller  set  of  numbers. 

The  common  technique  for  choosing  the 
terms  to  be  retained  in  Walsh  serieses  is 
threshold  sampling:  any  Walsh  function  whose 
coefficient  is  less  than  some  threshold  is 
dropped  from  the  series,  or  equivalently, 
assigned  coefficient  zero.  This  lesults  in 
the  retention  of  terms  with  largest  coeffic¬ 
ients  and  gives  an  approximation  that  is 
optimal  in  the  least  square  sense. 

There  are,  however,  two  disadvantages. 
One  is  that  it  is  impossible  to  know  before¬ 
hand  which  terms  will  oe  retained.  This  is 
an  extremely  aericue  problem  for  information 
transmission  problems.  For  example,  to  uee 
Walsh  functions  in  picture  transmission  it 
is  necessary  to  compute  all  the  Walsh  trans¬ 
forms,  select  those  with  largest  magnitudes 
and  send  these  values  over  the  channel  wi th 
their  indices  since  the  receiving  end  has  no 
knowledge  which  Walsh  transforms  would  be 
eelected.  This  results  in  an  increase  in 
required  bandwidth  partially  defeating  the 
purpose  of  ueing  Walsh  transforms.  The 
second  is  the  difficulty  of  error  analysis, 
since  threshold  stp.'.plmg  is  similar  to  round 
ing  by  setting  to  zero  any  number  that  is 
smaller  than  some  limit.  When  a  large  number 
of  terms  are  dropped,  the  theoretical  upper 
bound  on  the  total  error  is  simply  the 
number  of  terms  times  the  threshold.  This 
gives  an  enormous  upper  bound  which  is 
totally  unrealistic. 

The  lack  of  theoretical  analysis  of 
errors  is  no  headache  for  information  trans¬ 
mission  applications  since  trial  and  error 
experimentation  is  considered  quite  respect¬ 
able  and  has  indeed  produced  many  interest¬ 
ing  results.  Nevertheless  it  is  interesting 
to  knot  that  it  is  in  fact  quite  easy  to 
derive  fairly  realistic  upper  bounds  on  the 
approximation  eirors  of  Walsh  serieses  if  we 
group  Walsh  functions  by  their  degrees,  to 
be  defined  below.  When  we  neglect  a  group  of 
term#  with  the  same  degree,  the  errors  are 
related  and  do  not  accumulate  like  rounding 
errors. 


In  selecting  Walsh  functions  by  their 
degrees,  a  term  is  retained  in  the  series  if 
it  has  the  appropriate  degrees,  regardless 
of  its  magnitude.  Thus,  a  data  compression 
scheme  based  on  degrees  does  not  always 
choose  terms  of  largest  magnitudes.  However, 
though  our  selection  scheme  is  different 
from  threshold  sampling,  the  performances 
of  the  two  tend  to  be  very  similar,  for 
numerical  applications  at  least.  Thus,  pred¬ 
iction  of  the  performance  of  a  Walsh  series 
whose  terms  were  ..elected  by  their  degrees 
is  also  a  good  prediction  for  the  accuracy 
of  a  series  whose  terras  were  selected  by 
threshold  sampling. 

To  derive  upper  bounds  on  approximation 
errors  we  could  use  an  "integration  by 
parts"  technique  which  have  been  employed  in 
a  previous  worx[l]  studying  upper  bounds  on 
single  Walsh  tr^aforas.  In  some  r»ai 
upper  bounds  can  be  derived  by  direct  manip¬ 
ulation  of  certain  integrals.  To  avoid  copy¬ 
ing  tedious  mathematical  arguments  only  the 
main  results  will  be  shown.  Detailed  proofs 
may  be  found  in  [1]  and  in  a  subsequent 
paper pj.  We  shall  also  give  several  numer¬ 
ical  examples.  Finally,  extending  the  error 
uuulysis  technique  to  information  transmis¬ 
sion  problems  will  be  discussed. 


Ustnematical  Introduction 
Let  us  have 

t  «  (o.t^  ...  tk  ...)2£  [0,1) 

i  ■  (...  ...  ^2^1^ 2 

The  kth  Kademacber  function  is 

yo  -  (-Dtk 

and  the  ith  Walsh-Faley  function 

pal(i,t)  .  ff[yt)]lk 

k*l 

The  degree  of  pal(i,t)  is  defined  to  be 
the  position  of  the  first  1  in  i  : 

d(i)  -  nin  {k:2k>i}  , 

and  its  subdegree  position  of  the  oecond  1: 

d'(i)  .  min{k:2k>i-2d~1}  . 

The  total  number  of  1‘ a  in  i  is  called  the 
rank  of  psl(i,t): 
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*nd  its  ntglitfibjlity  is  defined  «« 

p(i)  -  £  iJt  +  r(i)  . 
k-1 

Given  a  function  ,i(t)  we  define  it*  Walsh 
transform  as 
1 

J  f(t)pal(i,t)dt  . 


For  each  i  in  the  above  expression  iH  , 
i  so  we  have  "+x 

pal(i,t)  -  Hj^tJpalQ.t) 

with  0^jC2N  .  Thus 

1  w 

e(N)  -  U,T)f(T)dV 


We  proved  elsewhere  that  for  all  k^r{i) 

Fi*<-l)k^k^(t)^  j...^  p«l(i,tk)dtk. .. 
0  0  0  0 

dt^dt  .  (l) 

That  is,  in  computing  F  we  can  different— 
f(t)  up  to  r(i)  times1and  simultaneously 
integrate  pal(i,t)  the  same  number  of 
times,  as  in  integration  by  parts.  This 
gives  the  following  upper  bound  on  magnitude 
of  F.[l]; 


As  the  integrand  is  non-zero  only  between 

t^  and  t^++  and  since  ,  is  1  for 
first  half  of  the  intervul  anj  -1  in 
second  half,  we  get 


N+ 


N++ 


|e(N)|-|2N^N  f(T)dT  -  /j  N+  f(T)dT| 
tN+  T 

-i2H(tN  iT+2-N-l  ‘’(VdVTi 


$  max|f '  (t)|  2~**~2  . 


|FJ  ^  max|f(r)(t)!2-i’(i)  .  <2) 

Thus  if  p(i)  is  large  then  F.  has  small 
magnitude  so  can  be  neglected. xThie  is  the 
reason  for  the  name  "negligibility". 

Truncation  errors 

Polyak  und  Scbreider  proved  that  [jj : 
2n-l 

2  pal(i,t)pal(i,T)  -  Ba(t,T) 
i-o 

where  Bn(t,T)  «  0  except  when  [^“t!  .  |2ntJ  , 
in  which  case  u  j  i.  j  . 

Bn( t,T)  »  2n  . 

W*n?ha11  consider  t  to  be  fixed.  Then 
B  (t,T)  i*  zero  if  T  is  less  than 

2  n{2ntJ  or  greater  than  2_“^nt+4|  and 
is  constant  in  between.  It  is  thug  a  block 
pulse  of  height  2“  and  width  2“n.  For 
convenience  we  shall  denote  2-n[_2ntj  by  tn, 

2'nl2“HJ  by  ta+  and  2-a[2at+lJ  by 
ta++. 

W©  cad  now  derive  an  upper  bound  on  the 
error  caused  by  dropping  terns 

to 

from  the  Walsh  series.  We  hare 

*(*)  -  2  F  pal(i,t)  . 
i-o  x 

Neglecting  2**  terms  causes  error 
2N+1-1  1 

«(N)  *  £  pal(i,t)j  pal(i,T)f(T)dT 

i-2N  0 


We  first  observe  that  each  of  the  2W 
terms  dropped  hnu  degree  N+l  .  We  then 
note  that  the  first  term  among  them,  F„}j  , 
has  upper  bound  2 

IM  $  max|r(t)l2-N-2  , 

according  to  (2).  Thus  the  upper  bound  on 
error  caused  by  dropping  .jN  terms  is  the 
same  as  the  bound  on  one  term.  We  see  that 
errors  do  not  accumulate  if  we  neglect  a 
group  of  terms  with  a  common  degree. 

Truncating  the  aeries  at  2N  causes 

error 

KU 1*001  +  ♦... 

^max|f'(t)|2~I,“1  . 

It  say  be  observed  that  truncation  at  2N 
amounts  to  neglecting  all  F.  with  degree 
larger  than  N  •  Note  also  that  truncation 
error  occurs  only  when  we  choose  2s  to  be 
less  than  the  number  of  input  data.  For 
example,  if  the  argument  t  is  given  as  an 
n  bit  number,  then  there  are  only  2a  dif 
ferent  values  it  can  take  on,  hence  there 
are  only  2n  input  numbers.  If  we  use  a 
2  term  Walsh  series  the  reprecent&tion  is 
exact  and  there  is  no  truncation  error. 

Data  compression  errors 

The  truncated  Walsh  series  contains 
2  terms,  which  can  be  gathered  into  N+l 
groups,  each  with  a  different  degree.  Thus 
tb«  group 

?2d_1  to  F2d-1 
contains  all  terms  with  degree  d. 

Suppose  we  take  the  group  with  degree 
d+1  and  chooec  to  neglect  ell  tsrme  in  it 
that  have  subdegreee  greater  than  d' ,  the 
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error  caused  ia 


not  bard  to  sea  why.  Equation  (2)  indicates 
that,  unless  f(t)  baa  large  high  order  de¬ 
rivatives  F  ia  small  if  ita  rank  ia 
large,  ao  it  is  unlikely  to  be  choaen  in 
threshold  sampling.  On  the  other  hand  selec¬ 
tion  by  degrees  tends  to  choose  teras  of 
small  second  degrees,  which  generally  asana 
that  i  contains  few  l'a  so  its  rank  is 
usually  saall.  So  both  scheaes  tend  to  sel¬ 
ect  low  rank  terms,  and  ao  have  similar 
performance. 


and  has  upper  bound 


Examples 


|e(d,d'  )j  4  max  f(t)  2~d~a'  ”3  ~~) 

We  may  note  that  the  first  term  among  the 
group  of  teras  neglected  is  F2d+2d'  wh*cil 
obeys 

!F2d+2d'!  $  *hx  f"(t)  2‘d"d''4. 

Thus  the  error  caused  by  neglecting  terms 
^2d+2d’  *2d**-l  thun  twice 

the  upper  bound  on  one  tera,  showing  again 
that  errors  do  not  accumulate. 

The  above  argument  shows  that  we  can 
select  teras  to  be  retained  in  a  Walsh 
aeries  according  to  their  degrees  and  sub¬ 
degrees.  Any  term  with  degroe  above  some 
pre-set  limit  is  neglected  (truncation). 

Then  each  tera  with  the  correct  degree  but 
a  subdegree  exceeding  some  number,  which  any 
be  dependent  on  the  degree,  is  dropped  to 
achieve  data  compression.  That  is,  for  each 
of  the  N->1  groups  we  specify  a  maximum 
subdegree.  The  error  caused  by  neglecting 
tne  set  of  terms  in  each  group  can  be  estim¬ 
ated  by  examining  its  upper  bound,  and  the 
total  approximation  error  estimated  by  sum¬ 
ming  all  the  upper  bounds.  The  total  number 
of  terms  kept  in  the  series  can  also  be  cal¬ 
culated  immediately.  We  can  thus  decide 
whether  the  Walsh  series  is  sufficiently 
accurate  and  economical  witnout  having  to 
actually  compute  it. 

Two  qiestions  must  be  answered.  First, 
do  the  upper  bounds  give  accurate  estimates 
of  actual  errors?  Second,  ia  the  performance 
of  this  scheme  for  selecting  terms  as  goed 
as  threshold  sampling?  We  note  that,  for  two 
series  with  the  same  number  of  terms,  ths 
one  chosen  by  threshold  sampling  gives  lass 
mean  square  error,  while  its  absolute  error 
may  be  unevenly  spread  over  the  function 
domain  so  that  the  maximum  error  may  net  be 
leas,  though  for  practical  oases  it  is  uot 
far  from  the  maximum  of  the  best  series.  Wo 
shall  see  later  that  the  error  upper  bound 
we  derived  it  a  good  though  far  from  perfect 
indicator  of  the  real  error.  We  shall  also 
see  that,  if  the  function  being  approximated 
has  sisable  high  order  derivatives  then  a 
seriea  selected  by  threshold  sampling  cont¬ 
ains  many  high  rank  terms  that  would  not 
normally  be  selected  if  selection  by  degrees 
is  used.  If  size  of  derivatives  does  not 
increase  rapidly  with  each  differentiation 
then  threshold  sampling  and  aelectiou  by 
degrees  tend  to  choose  the  same  termp.  It  is 


1.  We  first  give  an  example  to  illustrate 
the  misleading  rccr.!*«  one  gets  by  applying 
.'traightforward  error  analysis  to  threshold 
sampling. 

To  be  useful  a  Walsh  series  must  cont¬ 
ain  only  a  small  number  of  terms.  To  obtain 
such  a  series  we  can  either  choose  a  saall 

N,  compute  a  truncated  eerien  of  2^  terms 
and  drop  a  saall  part  of  them;  or  we  choose 
a  large  H  and  neglect  a  major  proportion  of 
the  2”  terms.  According  to  straightforward 
analysis  the  error  caused  by  dropping  terms 
is  proportional  to  the  number  of  teras  negl¬ 
ected,  oo  the  second  alternative  would  give 
enormous  dr.ta  compression  error.  This  was 
the  conclusion  reached  by  Foiyak  and  Schre¬ 
iner  £)]  in  their  study  on  iunction  approx¬ 
imation  using  Walsh  series,  hence  they 
truncated  their  examples  at  2^»64  and  used 
data  compression  ratio  of  around  50^  .  An 

a  result  their  Walsh  series  approximations 
are  little  better  than  tabulation.  Their 
seriea  for  f(t)  »  sin(^Jlt)  contains  25 
terms  and  has  error  about  0.008. 

We  chose,  instead,  N.8  and  dropped 
6o  ^2d+1-l  toT  tl*e  following  pairs 
of  («J ,  d* ) : 

(d,d')  -  (7,1), (6,1), (5, 2), (4, 2), (5, 2). 

Total  number  of  terms  kept  is  24,  the  trun¬ 
cation  error  is  bounded  by  .002.6  and  data 
compression  error  by  .0040.  The  commuted 
errors  are  a  little  less,  while  the  error 
of  dg  term  series  selected  by  threshold 
sampling  is  slightiy  smaller  yet.  If  t  ia 
given  to  8  bits  only  then  truncation  error 
is  eliminated  and  the  approximation  is  accu¬ 
rate  to  2"d  • 

2.  ¥e  took  f(t)  »  sxp(-t),  N»12,  and 
dropped  terms  for  pairs  of  (d,d’): 

11,0), (10,0), (9,1), (8,1), (7, 2).  (6, 2), 
5,5), 

..  well  a.  term.  Fuow  to  Fnm  # 

with  total  data  compression  error  bounded  by 

O, 0017.  The  actual  error  was  computed  to  be 
0.00156.  The  number  of  terms  kept  is  48.  For 
the  same  function  a  series  of  49  terms,  sel¬ 
ected  by  neglecting  all  terms  with  absolute 
values  less  than  0.00005,  has  maximum  errer 
of  0.00101.  43  terms  are  common  to  both  ser- 
ieses  but  6  terms  with  magnitudes  twice  or 
three  times  of  threshold  are  not  included  in 
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the  first  •trie*. 


if#  see  that,  in  above  two  examples  thre¬ 
shold  sampling  per  form#  better  than  selecti¬ 
on  by  degrees,  though  error  bounds  of  the 
latter  still  provides  a  rough  indication  as 
to  the  accuracy  of  the  former.  If  we  had 
treated  error  caused  by  threshold  sampling 
as  rounding  error,  we  would  have  derived  an 
upper  bound  hy  multiplying  the  threshold  by 
the  number  of  terms  dropped,  which  would 
give,  for  example  2, 

jerror|  £  0.2 

which  iii  quite  unrealistic. 

3.  The  function  xa  has  an  infinite  second 
derivative  at  the  origin.  As  the  error  bound 
for  selection  by  degrees  scheme  depends  on 
the  second  derivative,  we  would  expect  a 
Walsh  series  approximation  to  perform  poorly. 
Also,  bscause  the  function  has  very  large 
high  order  derivatives,  its  high  rank  Walsh 
transforms  would  be  sixsbls,  hence  would  be 
selected  by  threshold  sampling.  Indeed,  we 
found  that,  even  if  we  set  the  threshold  us 
high  as  0.0002  the  number  of  terms  is  still 
no  less  than  131,  while  the  orror  at  t-0  is 
0,05.  (maximum  error  for  ^  t  1  il  0.00132) 

However,  we  may  note  that  we  can  restr¬ 
ict  the  argument  to  between  (  and  1 
since  any  other  value  can  be  treated  by 
shifting  it  right  or  left  two  bits  at  a  time 
since  f i4nt)«2nf ( t)  ,  Ho  although  the  Walsh 
series  is  defined  for  t{(p,l)  its  srror 
for  t  between  0  and  \  is  immsteral. 

This  fact  is  taken  advantage  of  by  us¬ 
ing  the  following  function 

f(t)  .  0.5+t  0  <t«U.25 

-  t^  0.25  <  t<  1  . 

For  we  have  f“(t)  -  9  between  O  and  $■, 
so  that 

max  }f"|  -  |f"(})l  -  2  , 

and  the  error  would  fall  within  acceptable 
limits.  N  was  chosen  to  be  12  and 

(d.d1)  -  (ll,l),(l0,l),(y,l),(8,l), 

(7,1), (6,3), (5,3). 


ete  with  polynomial  approximation  as  the 
latter  requires  far  less  date  storage,  mem¬ 
ory  access  during  evaluation  and  total 
computing  time.  However,  the  hardware  impl¬ 
ementation  of  Walsh  series  appear  economical 
since  the  evaluation  of  a  Walsh  series  needs 
only  fixed  point  additions.  The  operations 
involved,  fetch  and  add  repeatedly,  are 
simple  and  can  be  speeded  up  at  little  cost. 

fo  finally  mention  that  it  is  also  pos¬ 
sible  to  estimate  the  signal  power  loes  due 
to  bandwidth  compression  if  wc  assume  that 
Walsh  transforms  are  selected  by  their  degr¬ 
ees.  Given  random  variable  x(t)  with  auto¬ 
correlation  function  V(t)  we  have  the  ith 
Walsh  power  spectral  element 

X.  -  jjpal(i,T1)pul(i,T2)V(T1-T2) 


2d+i-l 


<*VT2 


V(T1-T2)dT2dT1 

This  finally  leads  to 


The  reader  is  cuutionad  that  the  above  upper 
bound  is  unlikely  to  be  as  good  as  thoss  on 
truncation  and  data  compression  errors  of  s 
smooth  function.  Also,  it  is  possibls  that 
selection  by  degrees,  whose  error  is  a  wei¬ 
ghted  integral  of  the  xuuctiou  being  approx¬ 
imated,  causes  a  type  of  distortion  unacce¬ 
ptable  for  random  signals.  Only  experiments 
w->uld  give  final  answers. 

We  conclude  by  saying  that,  although 
Walsh  functions  are  discrete  and  binary, 
mathematical  analysis  of  Walsh  series  errors 
are  at  least  possible  and  trial- end-error 
experimentation,  though  still  necessary,  is 
not  the  only  thing  to  do. 


Total  number  of  terms  kept  is  58,  and  maxim¬ 
um  error  is  0.00119.  A  second  series  found 
using  threshold  sampling  has  the  some  number 
of  terms  with  error  0.00116.  The  two  eerie- 
ses  contain  51  common  terms. 
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ABSTRACT 

T'ne  paper  summarizes  results  of  our  investi¬ 
gation  Into  the  merit  of  Fourier  and  Walsh  pro¬ 
cessing  of  random  signals.  It  has  been  often 
conjectured  that  the  popularity  of  Fourier  pro¬ 
cessing  stems  from  the  fact  that  the  Fourier 
coefficients  of  stationary  signals  are  ui.corre- 
lated  and  that  the  Walsh  coefficients  are  "al¬ 
most"  uncoirtlated.  Our  results  demonstrate 
that  the  Fourier  coefficients  are  "almost"  un¬ 
correlated  while  the  Walsh  coefficients  are 
"rarely"  uncorrelated.  By  the  word  "almost"  we 
mean  that  as  the  data-block  size  (N)  Increases 
the  coefficients  become  uncorrelated  and  the  de¬ 
gradation  In  performance  due  to  residual  corre¬ 
lation  goes  to  zero.  The  word 

"rarely"  states  that  the  performance  degradation 
does  not  vanish  for  very  large  N,  except  In  very 
few  pathological  cases  (white  noi6e,  perfect 
correlation,  etc.). 

SUMMARY  OF  PREVIOUS  RESULTS 

In  earlier  papers  (see  references  1,  2,  3)  we 
have  established  the  following  results: 

1.  By  the  words  "spectral  signal  processing"  we 
invariably  Imply  that  after  the  spectral 
representation  of  a  signal  Is  computed  Its 
components  are  to  be  handled  independently 
of  each  other  In  the  next  processing  stage. 

2.  In  Filtering  and  Coding  applications,  and 
under  a  mean-square-error  fidelity  criterion 
the  optimal  spectral  representation  Is  the 
Karhunen-LoAve  expansion  (rendering  the 
spectral  components  uncorrelated). 

3.  If  [Aj]  1  =  1,2,...N  are  the  eigenvalues  of 
the  Input  covariance  matrix,  then  the  per¬ 
formance  of  the  Karhunen-Lo&ve  processing  Is 
given  in  the  form 


N 

*K-L*nIF(V 

1=1 

where  F(-)  Is  a  convex  function. 

4.  j  When  using  a  unitary  transform  U  other  than 

the  Karhunen-LoAve,  the  optimal  performance 
that  can  be  achieved  Is  given  by 

puBSIr(«J)  «> 

t=i 

where  Cj  (1  =  1,  2 . N)  are  the  varian¬ 

ces  of  the  spectral  coefficients  (or  the 
diagonal  elements  of  the  covariance  matrix 
In  the  U  representation) . 

5.  Thus,  the  degradation  in  performance  due 
to  incomplete  decorrelation  Is  given  by: 

N 

AR  =  N  I  [F(V  '  F<0£>]  (3) 

1=1 

SUWARY  OF  CURRENT  RESULTS 

Rather  than  calculating  equation  (3)  for 

every  possible  covariance  matrix  and  for 

every  performance  function  F  we  attempted 

to  find  a  condition  that  would  guarantee 

lim  AR  =  0  (A) 

N  -*  m 

for  all  weakly  stationary  signals.  Such 

condition  can  be  given  in  terms  of  the 
Hilbert-Schmidt  norm 

|  A  I2 «  isr  I  A  |2  (5) 

i  1  J 

2’  ts  a  Toeplitz  covariance  matrix  and 

Cjj  Is  a  circulant  approximation  of  T^  ob¬ 
tained  by  ignoring  all  off-diagonal  elements 
in  Its  Fourier  representation,  then 


A1"  I^n-SjI2  “  0  (6) 

N  -  ® 

(See  reference  4  for  proof. ) 

3.  If  (6)  Is  satisfied  and  T„  Is  bounded  then 

'"-ft 

(4)  is  guaranteed  (ref.  5).  This  implies 
that  Fourier  processing  is  asymptotically 
optimal  for  stationary  signals. 

4.  For  large  N  fiR  is  proportional  to  |Tlt  -Cu| 
in  both  Coding  end  Filtering  (ref.  4). 

5.  For  finite  order  Markov  processes,  IT^  -C^| 
approaches  zero  like  l//N~  (ref.  4). 

6.  The  last  two  statements  imply  that  the  per¬ 
formance  achievable  by  Fourier  Processing 
approaches  the  optimal  like  l//iT . 

7.  The  Walsh  transform  is  not  asymptotically 
optimal  for  stationary  signals.  The  per¬ 
formance  difference  between  Walsh  and  Kar- 
hunen-Lo&ve  processings  does  not  vanish  ex¬ 
cept  in  a  few  rare  cases.  This  can  be  es¬ 
tablished  by  observing  the  behavior  of 

JTjj  -  D^l  where  is  the  dyadic  approxima¬ 
tion  of  Tjj  (obtained  by  ignoring  the  off- 
diagonal  elements  of  W  1^  «  ').  In  most 
cases  |Tfj  -  D^|  reaches  a  non-zero  asymp¬ 
totic  value  for  large  N,  as  exemplified  by 
the  moving-average  process  in  figure  1. 

CONCLUSIONS 

In  signal  processing  applications  of  sta¬ 
tionary  inputs  (or  asyncronous  Inputs)  the 
Fourier  Transform  offers  a  definite  advantage 
over  the  Walsh  Transforms.  The  Fourier  Trans¬ 
form  is  asymptotically  optimal  for  all  weakly 
stationary  signals,  while  the  Walsh  Transform 
remains  suboptiual  even  for  very  long  blocks. 


(3)  Pearl,  J.,  Andrews,  H.  C.,  and  Pratt,  W.K., 
"Performance  Measures  for  Transform  Data 
Coding",  to  be  published  in  IEEE  Transac¬ 
tions  in  Co"<nunication  Technology,  June 
1972. 

(4)  Pearl,  J.,  "On  the  Finite  Fourier  Trans¬ 
form  of  Stationary  Time  Series",  to  be 
published. 

(5)  Gray,  R.  M.,  "Toeplitz  and  Circulant  Ma¬ 
trices:  A  Review",  Stanford  University 
Report  SU-SEL-71-032,  June,  1971. 


FIGURE  1 .  HILBERT  SCHMIDT  NORM  FOR 

FOURIER  (C„)  AND  WALSH  (D„)  TRANSFORMS 
-N  ~N 

OF  A  MOVING-AVERAGE  PROCESS. 
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Abstract 

The  coefficients  of  the  Walsh  series  of  a 
function  car.  be  used  to  derive  the  corresponding 
Fourier  series.  The  conversion  equation  for 
each  Fourier  coefficient  is  in  the  form  of  an 
infinite  summation  of  products  of  constants  and 
the  Walsh  coefficients.  Truncefon  of  tne 
conversion  equation  generally  gives  rise  ti 
errors.  It  is  shown  that  precise  evaluation  of 
the  Fourier  coefficients  in  terms  of  Wnlsh 
coefficients  is  r  ssible  if  the  sign3!  is  either 
sequencv-limited  or  frequency-limited  A  dual 
relationship  holds  for  Fourier  series  to  Walsh 
series  conversion. 

Introduction 

Instrunents  that  are  simpler  and  faster 
than  Fourier  analysers  have  been  developed  to 
yield  a  finite  number  of  Walsh  series  coeffi¬ 
cients  of  a  signal  [1,2].  In  many  instances 
the  Walsh  s-ectru*  of  a  signal  is  as  meaningful 
as  the  Fourier  spectrum,  and  sometimes  it  rs 
preferable:  nevertheless,  because  of  bandwidth 
restrictions  of  transmission  channels,  the 
Fourier  spectrum  corresnonding  to  a  given  Walsh 
soec>.rua  would  often  be  required. 

Riven  the  Walsh  coefficients  of  a  signal, 
the  corresponding  Fourier  coefficients  may  be 
evaluated  by  either  a  general-puroose  or  a  ' 
special -purpose  computer,  using  established 
conversion  formulae  [5] .  In  practical 
conversion  systems,  two  forms  of  truncation 
error  may  arise.  First,  the  word  lengths  in 
the  system  hardware  may  be  inadequate.  Such 
roundoff  errors  are  here  considered  to  be 
negligible.  Since,  ir.  general,  the  conversion 
equation  for  each  Fourier  coefficient  is  an 
infinite  sum  of  products  of  constants  and  the 
given  Walsh  coefficients,  a  second  and  wore 
important  source  of  error  is  ^truncation  of  the 
infinite  series  since  the  number  of  Walsh 
coefficients  will  always  be  finite. 

Signals  fall  into  four  spectral  categories, 

1.  Infinite  Walsh  scries  with  infinite  Fourier 
series, 

2.  Finite  Welsh  series  with  finite  Fourier 
series, 

3.  Finite  Walsh  series  with  infinite  Fourier 
series, 

4.  Infinite  Walsh  series  with  finite  Fouric. 
series. 

For  instrumentation  purposes,  the  last 
category  is  of  particular  inter  esc.  It  is 
shorn  below  chat  If  a  band-lino  ted  signal  with 
a  highest  normal \ rod  frequency  component 
(harmonic)  N  is  applied  to' a  Walsh  analyser 
whose  highest  normalised  sequency  component 
readout  is  M,  then  all  N  Fourier  harmonics  of 
the  signal  can  be  determined  without  trror. 


provided  that  M>N.  Thus,  instruments  that 
yield  a  finite  number  of  Walsh  coefficients  can 
be  used  for  the  precise  evaluation  of  the 
Fourier  coefficients  of  band-limited  signals. 
Furthermore,  a  substantial  easing  of  hardware 
requirements  in  a  special-purpose  Walsh  to 
Fourier  series  converter  (or  of  software 
-requirements  in  a  general-purpose  computer 
conversion)  is  achieved  if  one  puts  M  «  2X, 
where  x  is  an  integer.  Thus,  in  »  ;  design  of 
Walsh  spectral  analysers  for  use  on  frequency- 
) imited  input  signals,  the  highest  sequency 
component  to  be  measured  is  best  chosen  to  be 
a  Radcmacher  function  of  order  x.  A  dual 
relationship  holds  for  signals  in  category  3. 

Series  Conversion 

Let  f  function  f(8)  be  represented  by  a 
sequency-ordered  Walsh  series; 

m 

f(6)  “  A0  *  £  (Amcal(m,e)  +  Bmsal(m,8)]  (1) 
m»l 


The  coefficients  and  Bm  of  the  even  and  odd 
Walsh  functions,  respectively,  are  defined  by 


t/nere  m  is  the  normalized  sequency  and  8  is  the 
normalized  tir-e.  The  same  function  f{8)  has 
the  corresponding  Fourier  series 

ar  " 

f{8)  *  *  l  [ancos2itn8  +  bnsin2snej  (4) 

n«l 

where 

a  «  2  f(8)cos2im8  d6  (S) 

>0 

b  *  2[  f(fi}sin2im8  d8  (6) 

J0 

and  where  n  is  the  normalized  freque:._y  or 
harmonic  number.  It  is  desired  to  use  the  Walsh 
coefficients  Am  and  B^  in  order  to  derive  an  and 
bn.  We  first  consider  :ignals  in  category  1, 
i.e.,  that  have  both  infinite  Walsh  spectra  and 
infinite  Fourier  spectra. 

The  even  terms  an  of  the  Fourier  series  of 
a  signal  are  functions  only  of  the  even  terms 
A,,  of  The  corresponding  Walsh  series. 

Similarly  bn  terms  depend  only  on  3*  terms. 

Only  the  even  terms  arc  considered  belcw; 
similar  derivations  apply  for  the  odd  fcerms. 
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The  Walsh  to  Fourier  series  conversion 
relation  is  derived  by  equating  the  terms  of 
each  series: 


l 

n=l 


a  cos2imS 
n 


l  A  cal (m, 6) 
m*l  ffl 


(7) 


The  cal  functions  are  expanded  into  sets  of 
equivalent  Fourier  series  expressions  whose 
terns  have  coefficients  an  n,  where 


a 


n,n 


•f 

>u 


2  cal(n,0)  cos2sn9  d3 


(8) 


is  the  nth  Fourier  coefficient  of  cal{m,0).  The 
mxn  matrix  of  the  set  (an(ra)  is  denoted  F*.  In 
the  expansion  of  the  right-hand  side  of  Eq.  (7) , 
terms  containing  cc.s2ttn0  are  grouped,  yielding 
a„  values  given  by 


I 

m*l 


a  A 
n,ra  in 


(9) 


If  a  represents  the  nxl  matrix  of  the  set  (a^ 
as  and  A  represents  the  mxl  matrix  of  the 
set  {A,,}  as  »♦«•,  then 


a  *  F  A 


(10) 


However,  if  only  a  finite  number  M  of  Walsh 
coefficients  are_known,  then  an  can  only  be 
approximated  as  an,  where 


M 

I 

»*1 


a»  .  Am 

n,«  s 


(11) 


The  coefficients  ^  can  be  considered  as  the 
Fourier  coefficients  of  a  sequency-Iimited 
function.  The  mean-squared  error  introduced  by 
the  approximation  is 


a  -a 
1  n  n1 


!  I  a  A  | 

mil  n’n  m 


(12) 


Thus  approximation  errors  in  the  conversion  are 
dependent  on  the  Walsh  series  coefficients  of 
the  signals.  As  M  increases,  errors  tend  to 
decrease,  but  not  necessarily  in  a  uniform 
manner. 

Since  a  number  of  the  constants  a,,  B  are 
zero,  special  cases  arise  fo-  functions ’with 
infinite  Walsh  spectra  and  infinite  Fourier 
spectra  where  there  is  no  error  due  t  j 
truncation  of  Eq.  (3),  orc-vided  that  »  >  n.  One 
such  case  is  a  sawtooth  wave  which  is  periodic 
over  the  interval  (0,1);  it  has  Walsh  series 
coefficients  that  are  non -zero  only  for  a«2x 
where  x  is  an  integer,  so  the  conversion 
equation  for  each  8j,  has  only  one  non-zero  term. 

Fcquency- Limited  Functions 

Signals  with  sneetr?  in  categories  2  and  3 
are  sequency-Iimited,  with  Walsh  to  Fourier 
series  conversion  equations  of  the  form  of  Eq. 
(9) .  If  Aa«0  for  m  >  M,  the  mean-squared 
conversion  error  term  of  Eq.  (12)  is  zero 
provided  that  at  lenst  M  Walsh  coefficients  are 
wted  to  evaluate  a,,. 


Frequency-limited  Functions 

Functions,  other  than  constants,  which  have 
finite  Fourier  spectra,  necessarily  have 
infinite  Walsh  spectra.  If  a  function  f(9)  is 
band-limited  to  become  f(9)  with  a  limited 
number  of  harmonics  M,  and  if  ?(0;  is  applied  to 
a  Walsh  spectrum  analyzer  (see  Fig.  1)  to  yield 
the  first  M  Walsh  coefficients,  then  the  N 
Fourier  coefficients  of  f(0)  can  be  determined 
precisely  from  the  M  measured  Walsh  coefficients, 
provided  that  M  >  N. 


*0 


Ideal 
Low -pass 
I _ EUlfil— 


*0 


Figure  1.  Walsh  spectrum  aitelysis  of  frequency- 
licited  function. 


Writing 

N 

f(9)  *  1  a  eos2im9 

n 


(13) 


then 


-  * 

A  -  f(9)  cal{m,.9)d6 


A  «  I 

Jo 

N  fl 

*  l  [  cosSiffio  cal(m,0)d3]a 
n-i  '0  * 

or 

ft 

A_  »  7  A _ ,  a  «0  for  n  >•  N 

n  n«l  *»n  n  n 

where  AyiR  is  the  ath  Walsh  coefficient  of 
cox3rn9, 1  In  matrix  fons  Eq.  (15)  is  written 


(14) 


US) 


A  •  W  a 


(16) 


Since 


Am,n  *  *  sn,a 


07) 

W  >  F*  (18) 

t 

Ono  can  solve  for  a  in  t-i rar,  of  A  sp  ioi  hw. 
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-  .  T 

A  ■  F1  a 

(19) 

FA  »  h  F  Fr  a  »  K 

a  say. 

(20) 

so  that 

s  »  tf1  F  A 

(21) 

if  K  is  non-singular.  The  set  la-,?  can  be  solved 
by  a  system  of  N  linear  independent  equations. 
Thus,  M  must  equal  or  exceed  N.  It  can  be  shewn 
that  1C  is  indeed  ncn-singular  for  M  >  H.  Thus, 

the  first  N  Fcurier  coefficients  can  be  re¬ 
covered  with  no  truncation  error.  As  K 
become*  the  identity  matrix  and  Eq.  (21)  reduces 
to  Eq.  (10). 


Dt  tl  Relationship 

A  dual'  relat.  ,n  permits  the  determination 
of  Walsh  coefficients  in  terms  of  Fourier 
coefficients.  Eq.  (19)  can  be  used  to  find  the 
Walsh  .coefficients  of  a  band-limited  function. 
The  M  h’alsh  coefficients  ef  a  sequency-limited 
function  are  derived  from  the  first  II  Fourier 
harmonics,  nrovlded  that  N  >  M.  From  Eq.  (10) 

FT  a  *  f  _F  A  (22) 

.*.  A  «  (FT  F]"1  fT  a  (23) 

if  [Ff  FI  is  non-singular.  For  N=M;  i.t.,  for 
square  matrix  F  that  can  be  i-  verted, 

A  i  k  FV  if1  a  (24) 

It  xs  seen  that  the  aiovc  eqaiation  is  sim'lar  to 
Eq.  (19)  for  the  band-limited  case.  As  £-1 

becomes  an  identity  matrix. 


Instrumentation 


Digital  hardware  requi  rcmi.it s  for  a  special- 
puioose  Fouvisr  to  Walsh  or  Wa. sh  to  Fourier 
converter  (cr  software  requirements  for 
computers  to  achieve  titese  enus)  are  cased  bv 
using  an  important  property  of  the  matrix  K,  It 
can  be  shown  that  fo>  K*2-,  where  x  is  cn  integer, 
g  diagonal izer  with  diagonal  blcaencs 


n,n 


gx 

a  <*1 


v2 


sinc’Cn^**1)  ,  r.  t  2X 
2sinc2(i/2x*1),  n  2^ 


(25) 


This  property  can  be  established  by  showing  that 
the  lows  of  F  are  mutually  orthogonal  if 
M  *  2“  >  N. 


Toe  artricer-  F  and  K  recu'  in  each  of  the 
conversion  equations  (10),  (19.  (21)  ana  (24) 

for  band-limited  or  sequcncy-1  tinted  functions. 
By  taking  ad”antage  o*-’  the  diagonal  icing 
nropeTty  of  K,  a  minlaan  set  of  constants  can  be 
stored  in  reae-onlv  memories  (SOM)  of  a  digital 
converter  if  M«N«2*.  (Inly  thu  non-zero  elements 


of  a  [2X  x  2  ]  matrix  F  and  the  2X  diagonal 
elements  of  K  need  be  stored.  Peripherals 
about  the  ROM's  are  used  to  program  each  of  the 
conversion  equations.  Thus,  one  digital 
processor  can  perform  the  Walsh  to  Fourier,  or 
the  Fourier  to  Walsh  series  conversion. 

Conclusion 


As  a  general  procedure  for  Walsh  series 
and  Fourier  series  analysis  using  a  Walsh 
spectrum  analyzer,  the  Following  procedure  is 
adopted.  If  the  first  N  Fourier  coefficients 
of  a  signs!  are  to  bo  evaluated, 

a)  The  signal  is  passed  through  a  lov-paas 
filter  to  obtain  a  function  with  2X  or 
fewer  harmonics,  i.e.;  the  set  a. 

b)  The  function  is  analyzed  using  a  Walsh 
spectrum  analyzer  to  obtain  the  fiyst  2X 
Walsh  coefficients,  i.e.,  the  set  A. 

c)  foe  set  A  is  used  in  a  converter  that  is 
programmed  to  solve  Eq,  (21)  i.r  order  to 
evaluate  a.  If  only  the  Walsh  coefficients 
of  the  original  signal  are  to  be  measured, 
the  lawpass  filter  is  by-passed. 

Similarly,  a  Fourier  spectrum  analyzer  and 
scries  converter  can  be  used  for  precise 
evaluation  of  the  Walsh  coefficients,  provided 
the  signal  is  scquer.cy  filtered  before  analysis. 
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Introduction 

The  Walsh  power  spectrum  of  a  se¬ 
quence  of  random  samples  is  defined  as 
the  Walsh  or  sequency-ordered  Hadamard 
transform  of  the  logical  autocorrelation 
function  of  the  random  sequence.  The 
''logical'1  autocorrelation  function  is 
defined  in  a  form  similar  to  the  "arith¬ 
metic"  autocorrelation  function.  The 
Fourier  power  spectrum,  which  is  defined 
as  the  Fourier  transform  of  the  arith¬ 
metic  autocorrelation  function,  can  be 
obtained  from  the  Walsh  power  spectrum  * 
by  a  linear  transformation.  The  chain 
of  transformations  oan  be  s’lmmarized  as 


Fourier 


Arithmetic 

Autocorrelation 


Spectrum  _  Function 


of  a  discrete  random  process.  Tne  logi¬ 
cal  convolution  (or  correlation*)  func¬ 
tion  based  on  the  mth  window  is  defined 


L<m>  (k)  -  i  £  x(j  ©k)  >:(j)  (1) 

N  j  “0 

k  =  0/  If  •  «  •  /  N  -  1 

where  j  ©  k  denotes  the  modulo  2  sum  of 
the  integers  j  and  k. 

In  Equation  (1)  j  and  k  are  non- 
negative  integers  less  than  2n  -  1.  If 

Gr  =  JO,  1,  2,  .  .  .,  2ri  -  l} 

represents  the  set  of  such  integers, 
then  every  element  of  this  set  can  be 
expressed  in  binary  notation  with  n  co¬ 
efficients  which  are  either  zero  or  one. 
let 


Walsh  Logical 

Fower  Autocorrelation 

Spectrum  Function 

W"1 

The  top  half  of  this  chain  is  known  as 
the  VJiener-Khintchine  theorem,  while  the 
bottom  half  is  known  as  the  "logical" 
Wiener-fChintchine  theorem.  For  a  given 
process  with  computed  or  modeled  auto¬ 
correlation  function,  the  Fourier  and 
Walsh  power  spectra  are  computed  by 
using  fast  Fourier  and  Walsh  transforms, 
respectively.  Examples  arc  given  from 
speech  and  imagery  data. 

Logical  Convolution* 

Corsiuer  the  fo1 lowing  random  se¬ 
quence  of  length  N  =  2n,  where  n  is  an 
integer: 


x(j),  i  «  C.  1,  2,  . 


N  -  1 


Such  a  3equer.ee  can  be  assumed  tc  repre¬ 
sent  o  window  (or  a  block  of  N  samples) 

*A’.\so  called  dyadic  ucnvolt-ion. 


n-l 

3  *  £ 

1*0 

n-l 

k  =  £  ki2i 
i“G 

Ther  the  operation  ©  in  Equation  (1) 


j  ©h  =  £  2l  (2) 

i“Q 

where  ji©^*  represents  the  modulo  2 
addition  {i.e.,  binary  addition  without 
carry)  operation.  That  is, 

9©0  =  1©1  =  0 

0© 1  =  1©  0  =  1 

Table  I  shows  the  modulo  2  addition 
matrix  for  the  set  G3  ={0,  1,  .  .  7), 

where  j  indicates  the  columns  ar.d  k  in¬ 
dicates  the  rows  of  the  table.  The 


’’‘Dyadic  convolution  and  correlation  are 
identic*?.)  because  modulo  2  addition  and 
subs traction  are  identical  operations. 
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first  row  and  column  are  all  of  the  in¬ 
tegers  in  the  set  G3  in  increasing 
order,  since  che  modulo  2  sum  of  an  in¬ 
teger  and  zero  does  not  alter  the  inte¬ 
ger.  It  should  be  noted  that,  for  a 
certain  n,  if  the  matrix  is  divided  into 
four  2n'2  by  2n'2  matrices,  then  each 
matrix  is  symmetrical  with  respect  to 
both  diagonals.  Thus  Table  I  can  be 
generalized  and  extended  tor  n  >  3  by 
inspection. 


Table  I.  Modulo  2  addition,  given 
by  j  @  k,  for  integers  j  and 
k  between  0  and  7 


Table  IT,  which  is  derived  from 
Table  I,  shows  that  computation  of  the 
dyadic  autocorrelation  function  requires 
varying  amounts  of  time  shifts  for  vari¬ 
ous  k.  Time  shift  k*,  defined  by  the 
relationship 

j  +  k*  =  j  ©  Jc  (3) 

Table  II.  Time  shift  k*,  given 
by  k*  =  /j@k)  -  j,  for  in¬ 
tegers  i  and  k  between 
0  and  7 


has  a  certain  structure;  i.e.,  for  any 
n,  if  the  matrix  of  Table  II  i3  divided 
into  two  2n"1  by  2n  matrices,  then  the 
elements  of  these  matrices  have  odd  sym¬ 
metry  properties  for  any  k.  This  is 
equivalent  to  saying  that,  for  any  n, 
the  right  halt  of  the  shift  matrix  is 
the  mirror  image  of  the  left  half.  The 
particular  symmetry  properties  of  the 
shift  matrix  are  the  basts  of  the  re¬ 
cursive  relationship  between  the  logical 
and  arithmetic  autocorrelation  functions 
which  will  be  derived  next. 

Logical  Autocorrelation  Function 

The  logical  autocorrelation  function 
is  defined  as  the  expected  value  of  the 
local  logical  autocorrelation  function 
of  Equation  (1): 

L(k)  =  E|L<m>  (k)}  (4) 

where  the  expectation  operator  E  denotes 
the  ensemble  average  of  M  logical  auto¬ 
correlation  functions;  i.e., 

i  M 

Ink)  =  b  E  b(m)  (k)  (5) 

m=l 

k  =  0,  1,  .  .  .  ,  N  -  1 

The  relationship  between  L(k)  and  the 
"arithmetic"  autocorrelation  function 
R(k)  will  be  established  next.  For  a 
stationary  process  the  arithmetic  auto¬ 
correlation  function  is  even  and  a  func¬ 
tion  of  the  time  difference  only: 

e{x ( j  +  k*)  x(j)}  =  R(k*) 

R{-k*)  =  R(k*>  (6) 

For  a  logical  autocorrelation  function, 
if  Equation  (1)  is  written  in  matrix 
form  using  the  indices  of  Table  I,  one 
obtains  a  linear  combination  of  R(k)  for 
each  L(k).  This  relationship  can  be  ob¬ 
tained  recursively  for  any  n. 

Thn  R(k)  L(k)  transformation  may  ce 
easily  obtained  by  examining  Table  II. 
The  first  row,  which  corresponds  to 
MO) ,  yields  the  correlation  of  N  sam¬ 
ples  for  zero  time  shift;  thus  Equa¬ 
tion  (1)  yields  L(0)  =  R(C) ,  The  second 
row,  which  corresponds  to  L’(l),  yields 
the  expected  value  of  N/2  samp1es 
shifted  one  element  to  the  right  and  N/2 
samples  shifted  one  element  to  the  1  aft. 
Since  R(-l)  =  R(l),  the  second  row  re¬ 
sults  in  Ml)  =  Ml).  The  Nth  row  gives 
all  of  the  odd  shifts  up  to  N  -  1,  both 
to  the  right  and  to  the  left.  The  re¬ 
sults  are  shown  ir.  Table  III,  where  Lk 


— -7r  i"-‘J  l.-^i  i’e<  '^4'  -•  Ji^i,!-;'""^SJ'!'irra*rl"'/ 


and  %  denote  L(k)  and  R(k),  respec¬ 
tively.  It  should  be  noted  that 

I  !*/!•«  I  £  1 

which  is  similar  to 

|Rk/R0!  £  1 

Roth  logical  and  arithmetic  autocor¬ 
relation  functions  can  be  normalized  by 
R0,  since  R0  r-  L0  -  a2  j  <?  the  variance 
of  the  random  signal.  I ha;  is, 


*k  =  Lk/o2 
Pk  *  RkA*' 


(7a) 

(7b) 


Table  III.  The  relationship  between 
logical  and  arithmetic  autocor¬ 
relation  functions  £cr  time 
shifts  between  0  and  IS 


Arithmetic  to  Logical 

-  - 

Logical  to  Arithmetic 

h>  •  r« 

ao  •  s 

h  •  ri 

*>  *  h 

h  *  "i 

"2  - 

Lj  -  (Rj*R  1/2 

*i  ■  2ti  ■  h 

i4  ■  «4 

*4  *  <■( 

Ls  -  (R3*R5;/2 

«5  *  2VJV:  1 

h  *  <VV/2 

\  •  2h-h 

Lj  c  (R1*Rj*R5+R7)/4 

L«  -  ». 

’•  • 

L9  •  (R^R^/S 

Rj  •  2».9  4L7»2L5*L1 

h.0  "  *r‘64*10*^2 

*10  '  2L10'2Lf*a 

hi  •  <VVV*ii>'4 

*11  ■ 

l12  •  e.4**,j)/2 

h;  *  t*Wh:4*n)/4 

*11  •  ,ti)-ttii*!Wt) 

'h  *  <W"io*»i4l/4 

*14  ’  <‘-14'JLlC  L2 

l*ls  -  <R  ♦^♦ni*R7+R9^R11trl3»R15)/l 

hs  “  •hs*4Ln-',Vh 

Logical  Covariance  Matrix 

Logical  and  arithmetic  autocove.riance 
matrices  are  formed  as 


CA 


1 

P2 

P. 


0! 

1 

Pi 

P, 


(9b) 


where  CL  is  a  dyadic  matrix  and  CA  is  a 
Toeplitz  matrix.  The  discrete  Fourier 
transform  matrix  F,  whose  elements  are 
defined  as 

Mj,k  -  |  e"i(2VN)jk  (10, 

j ,k  =  0,  1,  .  .  . ,  N  -  1 
i  = 

does  not  diagonalize  either  or  tnese 
matrices.*  The  dyadic  matrix  of  Equa¬ 
tion  (3a)  can  be  diagonalized  by  a  Walsh 
transform  matrix  W,  whose  rows  are  the 
normalized  discrete  Walsh  functions  in 
order  of  increasing  number  of  sign 
changes  along  each  row.  For  example, 
for  N  =  4, 

r 

+  +  + 

+  i  - 

+  -  - 

+  -  - 


where  ±  denotes  il. 


^An- N  by  N  discrete  Fourier  transform 
matrix  diagonalizes  a  circulant  matrix 
which  is  defined  as 

{Cc}3  k  =  P((k  -  j)  mod  N] 

i.c.,  each  row  is  obtained  by  a  circu¬ 
lar  right  shift  of  the  preceding  row, 
and  thus  the  elements  of  the  first  row 
are  sufficient  to  determine  zhe  matrix. 


lCL 

=  a2i(j  ©  k) 

(8a) 

For  example,  for  N  =  4, 

( 

> 

1  Pi 

Pa 

P  3 

!Cn 

fj,k 

=  o2p(j  - 

k) 

(6b) 

Cc  =  a2 

P  3  1 

Pi 

P2 

For  example. 

for  n 

=  2, 

P2  P3 

1 

Pi 

"l 

1  j  l? 

*■* 

.Pi  P  2 

Pj 

1  . 

9  i 

*  i 

1  *3 

*2 

P 

'i  _ 

Cl  “  o  | 

(9a) 

Pi  =  s 

i  ~  —  2 

1 

*2 

*3  1 

°'3 

a 

0  0 

1 

i  =  0 

'»  1,  2,  3 

j 

0 

L-  2 

*2  *1 

1 

300 


~“^r 


Diagonalization  of  the  Covariance 
Matrices 

Let  the  matrix  equation 

Y  =  TX  (11) 

represent  a  linear  orthonormal  transform 
of  the  input  random  process  X.  The  co- 
variance  matrix  of  the  output  vector 
process  is,  by  .definition, 

cy  =  e|(y  -  y)  (y  -  y)*}  (12) 

where  E  is  the  expectation  operator, 

Y  is  the  mean  value  of  Y,  and  the 
superscript  *  denotes  the  conjugate 
transpose. 

Equations  (11)  and  (12)  result  in 

Cy  =  TCXT*  (13) 

where  Cx  is  the  covariance  matrix  of  the 
input  vector.  If  T  is  a  Walsh  transform 
matrix.  Equation  (13)  yields 

Cy  =  WCLW  (14a) 

since  W*  =  W.  The  matrix  Cy  is  diagonal 
and  the  diagonal  eT  '‘rents  are  the  Walsh 
transform  coefficients  of  the  vector 
{l0,  L,,  .  .  .,  Ln_,  .  (The  prime  de¬ 
notes  the  transpose.)  For  N  =  4  it  can 
be  checked  that  the  elements  cf  the  di¬ 
agonal  matrix  Cy  are  given  as 

=  a2 {l  +  4,  +  42  +  *3} 

-  aMl  +  A,  -  *2  -  4, } 

Aj  =  o2ji  -  i,  -  i2  + 

A»  =  c2{l  -  4,  +  42  -  4,| 

If  Cx  in  Equaticn  (13)  is  the 
Toeplitz  form  defined  by  Equation  (9b) , 
the  linear  transform  matrix  that  di¬ 
agonalizes  CA  is  the  Karhunen-Lo&ve 
transform  matrix  K,  whose  rows  are  the 
eigenvectors  of  CA.  For  a  real  random 
process  X,  K  is  real  but  not. symmetric. 
Therefore  Equation  (13)  results  in 

Cy  »  XCaK'  (14b) 

where  the  prime  denotes  the  transpose. 

Cy  is  diagonal  and  the  diagonal  elements 
are  given  by  the  eigenvalues  of  CA,  For 
example,  for  N  =  4,  r.he  eigenvalues  of 
CA  of  Equation  (9b)  have  been  obtained 
by  using  the  decomposition  approach 
given  by  Ray  and  Driver.3  If  p3  <  p2 
<  p( • <  1,  then  the  eigenvalues,  in  de¬ 
creasing  magnitude,  are 


Af  =  a2 

P  ,  P  3 

1  +  r-  +  t 

.  — 1 

lil1  ~  J1)  +  (P1  +  P2)2j 

Aft  =  a2 

1  “  T-  "  3T 

“1 

+  1 

*  <»,  -  ..)•] 

>* 

II 

a 

N 

3  .  P  1  .  P  3 

1  *  *5‘~  * 

—  -i 

"I 

/( * «».  *  ».>*j 

II 

a 

N> 

« - !-* - n 

“V(^  -  t)  +  (p>  "  p*)2] 


In  the  case  of  a  circulant  matrix, 
Equation  (13)  results  ir.  a  diagonal 
matrix  given  by 

Cy  =  FCcF*  (14c) 

The  diagonal  elements  are  the  discrete 
Fourier  transform  of  the  vector  |p0,  P,, 
P2,  P3}'.  For  example,  for  N  =  4, 

Ao  =  o2(l  +  Pj  +  p2  +  p3) 

A^  =  c2(l  -  ip,  -  p2  +  ip3 ) 

Af  =  a2  (1  -  P,  +  p2  -  p,) 

A j  =  a2 (1  +  ip,  -  p2  -  ip3 ) 

The  Relationship  Between  Fourier  and 
Walsh  Transforms  of  a  Vector 

Given  an  input  vector  X  of  size  N, 
the  Fouriar  and  Walsh  transform  coeffi¬ 
cient  vectors  are  defined  by 

YF  =  FX 

Yw  =  WX 

Then 

YF  =  BYW 
YW  =  B~lYF 

where  B  =  FW  is  a  complex  matrix.  Since 
F  and  W  are  unitary  matrices,  B  is  also 
unitary;  i.e.,  E~l  =  B*.  The  relation¬ 
ship  between  the  Walsh  and  Fourier 
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coefficients  is  a  one-to-one  linear 
transformation. 

Arithmetic  and  Logical  Wiener- 
Khintchine  Theorems 

Let  Y(k)  be  the  Walsh  transform  of 
the  sequence  x(j)  representing  the  mth 
window  of  the  time  function.  Then  the 
energy  spectrum  of  the  window  is  defined 
as  Sro(k)  =  | Y (k)  |  2  for  k  =  0,  1,  .  .  ., 

N  -  1.  The  Walsh  power  spectrum  Pw  is 
defined  as  the  mean  of  M  local  energy 
spectra: 


*W<«>  =  pf  £  Sm^ 


Gibbs1  has  shown  that  Pw(k)  is  the  Walsh 
transform  of  L(j)  (the  logical  Wiener- 
Khintchine  theorem);  i.e., 

Pw(k)  A.  L(j) 

This  transform  pair  is  defined  explic¬ 
itly  as 


pwUO  =  jr  £  L(j)  wal  (k, j,N) 
j=0 

k  =  0,  1,  .  .  .,  N  -  1 


L(j)  =  £  PwUO  wal  (k,j,N) 
k=o 

j  =  0,  1,  .  .  .,  N  -  1 

where  wal  (k,j,N)  is  the  discrete  Walsh 
function  of  length  N  defined  over  the 
normalized  interval  from  0  to  1,  k  is 
the  independent  variable  taking  N  =  2r 
discrete  values,  and  j  is  the  number  of 
sign  changes  over  the  unit  interval. 

The  power  spectrum  of  a  random  pro¬ 
cess  is  the  Fourier  transform  of  its 
autocorrelation  function.  That  is, 


If  the  linear  transformation  shown  in 
Table  III  is  denoted  as  TA_L  (transfor¬ 
mation  from  arithmetic  to  logical), 
then,  for  a  given  random  sequence  X(j), 
the  power  spectra  in  the  Fourier  and 
Walsh  domains  are  related  as 


F(j,k) 

PF(k)  K(j) 

F-1(j,k) 


W(j,k) 

L(j)  Pw(k) 

»  w“’(j,k) 


where  Pp  and  P«  are  the  Fourier  and 
Walsh  power  spectra,  and  F(j,k)  and 
W(j,k)  are  the  discrete  Fourier  and 
Walsh  transform  matrices,  respectively. 

This  chain  of  transformations  gives 
the  linear  relationship  between  the 
power  spectra  in  the  Fourier  and  Walsh 
domains;  the  left  half  of  this  chain  is 
known  as  the  Wiener-Khintchine  theorem, 
while  the  right  half  is  known  as  the 
logical  Wiener-Khintchine  theorem. 

Recursive  Relationships  Between 
Logical  and  Arithmetic  Auto-~ 
correlation  Functions 

The  transformation  given  on  the  left 
half  of  Table  III  can  be  written  in 
matrix  form  as1* 

TA-L  =  DNTN  (16) 

where  DN  is  an  N  by  N  diagonal  matrix 
whose  elements  are  given  by 

<Hj,j)  =  mj1 

m(j;  =  2vi_1+l5  tj'0)  (17) 

j  =  0,  1,  2,  .  .  .,  N  -  1 

In  Equation  (17)  Vj  represents  the 
number  of  l's  in  the  binary  representa¬ 
tion  of  j,  6 ( j , 0)  is  the  kronecker  delta 
function,  and  mj  is  shown  in  Table  IV 
for  integers  between  0  and  15.  In  Equa¬ 
tion  (16),  Tn  is  an  N  by  N  matrix  which 

Table  IV.  Elements  mj  of  the 
inverse  diagonal  matrix  D^1 
for  integers  between 
0  and  15 


j 

Decimal 

Binary 

0 

0000 

1 

0001 

2 

0010 

3 

0011 

4 

0100 

5 

0101 

6 

0110 

7 

0111 

8 

1000 

9 

1001 

10 

1010 

11 

1011 

12 

1100 

13 

1101 

14 

1110 

15 

1111 
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The  linear  transformation  Tl-a,  which 
gives  the  relationship  between  the  logi¬ 
cal  and  arithmetic  autocorrelation  func¬ 
tions,  is  the  inverse  of  TA_L  of  Equa¬ 
tion  (16).  That  is, 


where  Dj}1  is  an  N  by  N  diagonal  matrix 
whose  elements  are  given  by  mj,  j  =  0, 
1,  .  .  . ,  N  -  1,  of  Equation  (17). 


imagery  data,  there  is  a  high  correla¬ 
tion  between  consecutive  samples.  A 
typical  value  of  the  correlation  coeffi¬ 
cient  is  p  =  0.9. 

The  discrete  Fourier  power  spectrum 
is  the  Fourier  transform  of  the  sample 
autocovariance  function  multiplied  by  a 
suitable  weighting  function.  The 
weighting  function  used  is  the  Parzen 
kernel: 


The  simple  transformation  between  the 
arithmetic  and  logical  autocorrelation 
functions  suggests  a  more  efficient  way 
to  compute  R(k),  k  =  0,  1,  .  .  . ,  N  -  1. 
Computation  of  L(k)  requires  the  Walsh 
transform  of  the  sequence  and  the  Walsh 
power  spectrum  of  Equation  (15)  obtained 
by  averaging  over  overlapping  windows. 
Then  a  second  Walsh  transform  (the  in¬ 
verse  Walsh  transform,  which  is  identi¬ 
cal  to  forward  Walsh  transform)  yields 
L(k) . 

The  fast  Walsh  transform  can  also  be 
used  for  computing  the  cyclic  convolu¬ 
tion  of  two  time  series.  This  approach 
requires  less  multiplication  than  the 
FFT  technique  for  sequences  shorter  than 
N  1024. 


Examples 

First-Order  Markov  Process 


Experimental  evidence  indicates  that, 
for  most  imagery  data,6'7  the  '  rst- 
order  Markov  process  is  a  reasonable 
model  for  the  one-dimensional  auto¬ 
correlation  function.  For  sampled 
images,  the  autocorrelation  sequence  is 

R(k)  =  R (0)  p I K 1 

k  =  0,  1,  2,  3,  .  .  . 

where  R(0)  =  a2  is  the  variance  of  the 
signal  sequence.  For  an  image  frame  of 
L  by  L  samples  (L  is  typically  equal  to 
512),  the  biased  sample  autocovariance 
function  has  been  computed  (for  N  lags) 
for  each  line  of  the  frame 

.  L-k 

RL(k)  =  i  V  x(i)  x(i  +  k} 

L  i=o 

k  =  0,  1,  .  .  .,  N  -  1 

and  averaged  over  the  total  number  of 
lines.  It  is  seen  that,  for  most 


For  N  =  32  and  p  =  0.S,  R(k),  h(k),  and 
their  product  are  shown  in  Figure  1. 

This  figure  also  shows  the  unweighted 
case  for  p  =  0.5.  Figure  2  shows  the 
logical  autocorrelation  functions  ob¬ 
tained  from  unweighted  and  weighted  R(k) 
by  using  the  relationships  given  in 
Table  III.  The  discrete  values  on  the 
curves  are  joined  by  straight  lines  to 
show  several  cases  on  one  curve. 

Figures  3  and  4  show  the  Fourier  and 
Walsh  power  spectra  computed  from  un¬ 
weighted  R(k)  and  L(k)  by  means  of  fast 
Fourier  and  fast  Walsh  transforms.  Fig¬ 
ures  5  and  6  are  the  same  as  Figures  3 
and  4,  except  that  N  is  equal  to  16. 

One  should  nox.e  the  similarity  of  the 
Fourier  and  Walsh  spectra  to  the  spec¬ 
tral  representation  of  the  first-order 
Markov  process  in  terms  of  the  first 
16  eigenvalues  of  the  covariance  matrix 
(Figure  7) . 

Speech 


Continuous  speech  of  30  seconds  dura¬ 
tion  was  sampled  at  8000  kHz.  The 
speech  material  consisted  of  five  test 
sentences  read  by  a  male  and  female 
talker.*  For  N  =  32  lags,  Figure  8 
shows  the  computed  autocorrelation  func¬ 
tion  for  the  male  talker,  unweighted  and 
weighted  by  the  Parzen  kernel.  Figure  9 
shows  the  weighted  logical  autocorrela¬ 
tion  function  [obtained  from  h(k)  R (k ) ] 
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and  the  unweighted  logical  autocorrela¬ 
tion  function  for  the  male  talker.  Fig¬ 
ures  10  and  11  show  the  Fourier  and 
Walsh  power  spectra  computed  from  R(k) 
and  L(k)  by  means  of  fast  Fourier  and 
Walsh  transforms.  Figures  12  and  13 
show  the  Fourier  and  Walsh  power  spectra 
for  N  ■  16  for  both  talkers. 

Figure  14  shows  the  spectral  repre¬ 
sentation  of  the  speech  process  (consid¬ 
ered  to  be  stationary  for  a  15-second 
duration)  in  terms  of  the  eigenvalues  of 
the  covariance  matrix.  One  should  note 
the  appearance  of  a  more  complex  for¬ 
mant  structure  in  the  Walsh  power  spec¬ 
tra  (Figures  11  and  13)  if  no  weighting 
is  used;  the  first  "spurious"  formant 
appears  at  an  odd  (namely  third)  multi¬ 
ple  of  the  first  formant.’  Hence,  the 
effect  of  weighting  is  to  reduce  the  ef¬ 
fect  of  high-order  Walsh  coefficients. 

Summary 

The  recursive  relationship  between 
arithmetic  and  logical  autocorrelation 
functions  of  a  stationary  process  is  de¬ 
rived.  The  Fourier  (Walsh)  power  spec¬ 
tra  are  computed  from  the  weighted 
arithmetic  (logical)  autocorrelation 
function  by  means  of  fast  Fourier 
(Walsh)  transforms.  Examples  from 
speech  and  imagery  data  show  that  the 
discrete  Fourier  and  Walsh  spectra 
closely  resemble  the  spectral  represen¬ 
tation  of  these  processes  in  terms  of 
eigenvalues  and  eigenvectors  of  the  co- 
variance  matrix. 
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Figure  1.  Arithmetic  autocorrelation 
function  of  the  first-order  Markov 
process,  N  =  32 


Figure  2.  Logical  autocorrelation 
function  of  the  first-order 
Markov  process,  N  -  32 


-*-k 


Figure  3.  Discrete  Fourier  power 
spectrum  of  the  first-order 
Markov  process,  N  =  32 


Figure  4.  Discrete  Walsh  power 
spectrum  of  the  first-order 
Markov  process,  N  =  32 
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Introduction 


i  The  theory  of  linear  continuous  time  systems, 
the  dynamic  differential  systems,  is  well  known 
and  advanced  [l,2,3,4].  The  name  system  theo¬ 
ry  has  been  first  introduced  by  KUpfmtiller  in 
his  famous  book  on  system  theory  in  communi¬ 
cation  [l].  In  recent  years  the  system  theory 
has  been  generalized  to  a  mathematical  concept 
for  abstract  relations  between  input-  and  output- 
spaces  even  for  non-physical  systems.  The 
map  in  time-differential  systems  is  given  by 
the  Fourier-  and  Laplace-transform  because  the 
frequency  domain  description  is  usually  clearer 
than  the  time  domain  representation.  Modern 
system  analysis  is  determined  in  an  increasing 
manner  by  numerical  methods,  digital  computer 
simulations  and  system  synthesis  by  digital 
hardware  circuitries  [ 5, 6].  Therefore  the  theo¬ 
ry  of  generalized  linear  discrete  systems  must 
be  advanced.  Using  suitable  generalized  samp¬ 
ling  theorems  the  transition  from  the  continuous 
to  the  discrete  domain  will  be  possible[7]. 
From  the  mathematical  point  of  view  linear  dis¬ 
crete  system  theory  is  linear  algebra  and  con¬ 
venient  matrix  notations  are  used  in  this  paper. 
First  a  short  introduction  to  discrete  generali¬ 
zed  convolution  theory  will  be  given. 


Generalized  Convolution 

Many  discrete  linear  systems  are  described  by 
the  following  input-output-relation 

2-1 

y(v)  =  2  h(i/,k)  x(k) 
k=0 


mensionul  space  the  standard  basis  is  defined 
in  the  usual  way 


e. 


% 


:n-l  ^ 


wiiere  e^.  .e^p  denote  the  unity  vectors.  The 
first  unity  vector  e-  is  also  called  discrete 
unit  impulse  i  and  tnis  is  closely  related  to  the 
Dirac's  function  ir.  continuous  systems. 


If  the  inputsignal  is  a  unit  impulse  the  output 
function  is  called  system  response  or  system 
function.  With  respect  to  the  definition  of  the 
standard  base  the  discrete  signals  are  written 
as  ccl'1  n  vectors 


lxo 

y0 

Jo 

X1 

yl 

Ji 

*2 

h  « 

> 

\v.v 

ti 

\'-v 

{h2n-it 

X2n-1 

*  1 

1*2*1 1 

and  the  matrix  notation  of  the  convolution  is 
given  as 

v=Hx=  h  #  x 

The  matrix  H_  is  called  system  matrix  and  in 
the  special  case  of  convolution  the  matrix  11  is 
generated  by  a  general  linear  operator  called 
translation  operator 

H  =  [h!Y(l)lllY(2)ill.^(k)iiI..JX.(2a'1Vl 
a  -  Dil  n(1)i  il(2)u  ii(k)|..jjL(2n'1)] 


with  the  integers  p,k  «  N(n)  =  |0,l,2...2n-l} 
The  equation  above  represents  a  generalized 
convolution  system.  In  the  finite  linear  2n-di- 


The  translation  matrix  V  0>  is  the  unity  matrix 
j£  and  the  columns  ol  the  convolution  matrix  H. 
are  given  as 


If  tna  system  matrix  h  is  a  regular  2nx2n 
matrix  with  2“  linear  independent  eigenvectors 
the  discrete  convolution  is  mapped  by  the  simi¬ 
larity  transform  onto  the  diagonal  [8] 

Q.  H  fit'1  =  Diag(X.) 

where  X.  ace  t^e  eigenvalues  of  the  convolution 
matrix  and  G_"  is  called  modal-matrix  or  ma¬ 
trix  of  the  eigenvectors.  Tno  transform  requires 
the  determination  of  the  eigenvalues  and  eigen¬ 
vectors  as  given  by  the  following  equations 


det(H'AE)  =  0 

(ii-XS)a.  -  0 


nuous  time-differential  system  and  the  genera¬ 
lized  discrete  spectral  transit  xm  G  bv  the  La¬ 
place  transform  we  get  the  well  known  convo¬ 
lution  theorem 

y(t)  ■  h(t)  *  x(t)  Y(p)=H(p)X(p) 


Figure  1.  Spectral  representation  of  discrete 
convolution  systems 


Thus  the  convolution  theorem  is  defined  as 


G.  (U  *i:)  =  2iaa(X.)  Gx 

Using  the  notations  of  Tickler  [9]  and  defining 
a  componentwise  multiplication  •  the  theorem 
reads  as 


I 


h  *  x 


£=  X#5 


with  the  following  notations 


S.  ~  ~  1.  x_  =  G  x 


A 


and  the  point-wise  multiplication  of  the  vector 
entries 


y.  =  <X.£).  =  A.S. 


We  call  the  diagonal  matrix  of  the  eigenvalues 
spec  tr  el  matrix  and  the  vector  of  eigenvalues 
spectral  function  of  the  system.  A  basic  block 
diagram  is  presented  in  figure  1. 

If  we  replace  the  discrete  system  by  a  conta¬ 


in  these  generalized  systems  the  transform  G 
is  depending  on  the  convolution  operator  and 
the  system  function  h.  In  some  special  tvpes  oi 
convolution  systems  there  is  a  onc^to-one  cor¬ 
respondence  between  the  eigenvalues  and  the 
system  function  given  as 

X  =  h  =  G  h 

and  the  determination  of  the  eigenvalues  and 
eigenvectors  is  reduced  to  a  linear  transform. 
The  convolution  theorem  now  reads  as 

^  =  h  *  x  ^ — «*•  £  =  K  •  x 

and  the  system  configuration  of  figure  1.  is 
simplified  to  that  of  figure2. 
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Figure  2.  Spectral  representation  of  special 
convolution  systems 


For  a  physical  rct'isation  iask  tho  following 
theorems  must  be  satisfied 

Causality;  The  system  is  non-anticipative, 
if  the  system  matrix  is  a  lower 
triangular  matrix. 

with  the  definition  of  causality 

h(p,k)  =  0  for  t<  k 
the  system  matrix  is  given  by 


hl,°  hl,  1 

hM  hp,i 


I 


h:n-i,2n-i 


Shift  invariance:  A  linear  discrete  system 
is  shift  invariatjrty  iff  each 
shift  matrix  V.'  '  commu¬ 
tes  with  the  system  matrix. 


Proof: 


H  v'k^ 

=  H  V^k)x 
H  =  V(k)  H  V(k)_1 
H  V(k)=  V(k)  H 


k  €  {0,1,2 - 2r_l] 

Besides  this  invariant  shift  matinees  must  sa¬ 
tisfy  the  following  theorem: 

The  first  column  of  the  k-th  shift  matrix 
is  identical  with  the  k-th  unity-vector. 

Proof: 

(k)  =  v(k)  H  S0 

•  •  (k)  u 

=  H  V(  %=U.£k 


Mutual  Mappings 

Two  arbitrary  systems  with  different  matri¬ 
ces  are  distinguished  by  the  index  (a)  and  (b). 
Using  the  matrix  notations  of  the  foregoing 
chapter  we  write 

*(a)  “  ^a)  -  *ib)  =  M(b)  * 


In  both  systems  the  input  function  must  be  the 
same.  There  exist  three  basic  mutual  mappings 
between  the  two  systems  and  we  define 

1)  mutual  input  mapping 

*(a>  !  *"*(a)*H(b)  :  *U)**(a) 

—(b)  ?  —  ^^b)**— (a)  :  —(b)  "*  2(b) 

2)  mutual  output  mapping 

— (a-*b)  :  2(a)"*  2(b) 

— (b-*a)  ‘  2(b)  2(.) 

3)  mutual  system  mapping 

“(a-b)  =  ^(b)^  "  fi(b)  2(a) 

— (b-*a)  *  —(a)  -  “(a)  2(b) 

Figure  3.  is  illustrating  the  three  basic  maps 
between  the  two  linear  discrete  systems. 


r 

4  I  ■ 

H  *(*>  hlflH 

I  t~4r| 

a)  Input -Transform 

b)  Output  -Tronform 

b»L,  s<>, 

i - 

**» 

e)  Systom- Transform 

Figure  3.  Block  diagram  of  the  three  basic 

mappings  between  two  linear  systems 

Convenient  matrix  descriptions  of  the  basic 

mappings  are  presented  as  follows: 

*(a)  =  X(a)*  *(b)  *  X(b)  ~ 

The  input  mapping  is  done  by  a  linear  trans¬ 
formation  representing  also 

discrete  systems  denned  as 

X,  \  =  H,.  71  H,  X,w,  =  H,  % 

—(a)  —(b)  —(a)’  —(b)  “(a)  Mb) 


-  ^12 


The  two  inpn:  transform  systems  are  mutually 
inverse 


The  convolution  theorem  now  reads  as 


“(a)  “  -(b)  1 


The  mutual  output  transform  defines  the  rela¬ 
tions  between  the  outpi’t-tunctions  of  the  dis¬ 
crete  systems  also  representing  an  output-trans- 
forni  system  with  the  system  matrices 

i(b)  ~  —  (a-«b)  -^-(a)  ”  "^(b)  —(a)  -^-(a) 

1(a)  =  X(b-*a)  ^(b)  =  H(a)  U(b)  ^(b) 

and  also  the  output-transforms  are  inverse  to 
each  other 


— (a-*o)  —  (b-*a) 


For  a  spectral  representation  of  the  two  systems 
we  use  the  spectral-output-transform  defined  as 

2(b)  3  — (a^b)  2(a)  =  G(b)  I(b) 

2(a)  =  ^(b-*a)  2(b)  =  fi(a)  I(a) 

,  1 

2(a-*b)  =  «xi(b))  %b)%aj 


Y,  .  =  Uiaq(\. /  >)  Gt  ,G,  .  Diaq(-; - ) 

— (b-»a)  - a  i(a)  -(a)-(b)  - ^  \(b) 

and  2(  )  and  .2(b)  are  sPectral  outputs  of 
the  systems. 

We  are  now  interested  in  developing  matrix  no¬ 
tations  for  the  mutual  system  mapping. Tne  two 
convolution  systems  are  mapped  by  the  two 
similarity-transforms  onto  the  diagonal  spectral 
matrices 

21§a(Xi(a))  =  ~(a)  -(a)  S(a)  1 

2isa(Xi(b))  =  S(b)  tt(b)  ^b)’1 


If  the  twp  considered  systems  are  different 
the  following  transform  yields  no  diagonal  spec¬ 
tral  matrices 


-(a-b)  “  fi(b)  —(a)  a(b) 


— (b"*a)  =  ~(a)  a(b)  “(a) 


Q(b)  (ll(a)^2t)(a)  ‘  &(a-«b)S(b)* 

-(a)  (il(b)'(-)(b)  =  %->a)fi(a)* 

The  transformation  onto  the  spectrcl  domain  of 
the  other  system  is  shown  in  figure  4.  This 
map  will  allow  a  comparison  between  two  ar¬ 
bitrary  convolution  systems  in  the  spectral  do¬ 
main.  By  means  of  mapping  high  sophisticated 
convolution  systems  onto  the  spectral  domain 
of  well  known  systems  as  for  example  onto  the 
discrete  frequency  or  Fourier  domain  this  also 
will  help  us  to  have  a  better  understanding  of 
new  convolution  operations. 


Figure  4.  Mutual  system  mapping 

Because  calculations  operating  in  the  spectral 
dor  .ain  with  the  spectral  functions  are  often 
easier  than  the  convolution  operation  in  the  ori¬ 
ginal  domain  we  now  derive  matrix  notations 
using  the  spectral  functions 

^(a-b)  =  —(b)  —(a)  2isa(XiIa;-(a)S(b)1 

-(b-a)  =  %a)-(b)  15isa(Ai(b))5(b)-(a)1 

where 

—(b)  —(a)  “  X(a-«b) 

%a)  ~(b)  1  =  ^b-a) 

and  we  call  the  matrices  T  mutual  spectral 
transform  with  the  following  relation 

X(a-*b)  =  X(b-»a)  1 
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The  matrix  is  symmetric  and  orthogonal 


In  the  special  case  of  integral  transforms  in 
linear  continuous  systems  there  were  given  in 
[lO]  three-dimensional  representations  for  the 
mutual  spectral  transformation  of  Walsh-  and 
trigonometric  functions. 


Cyclic  and  uyadic  system? 


The  cyclic  coi. volution  tiieoiem  is  defined  as 


F  (h^  *  x)  =  h  •  £ 


In  the  foregoing  chapters  we  have  derived  some 
general  matrix  notations  and  now  we  want  to 
apply  this  on  two  systems:  circular  and  dyadic 
convolution  systems. 

The  circular  or  cyclic  convolution  is  well  known 
and  that  because  of  the  strong  physical  back¬ 
ground.  The  differential-systems  are  replaced 
by  the  difference-systems  and  the  input-output 
relation  is  given  by 

2n-l 

y(f)  =  2  h(p-k)x(k) 
k=0 

P,k  f  N(n)  =  {0,1,2 . 2°- 1} 

The  relation  to  the  generalized  convolution  is 
given  by 

h(i/,k)  :=  h(t/-k)  n 
mod  2 

If  we  have 


The  basic  rules  of  dyadic  convolution  theory 
were  first  introduced  by  Fichler  ( 12, 13, 14] 
and  Gibbs  [l5, lo]. A  short  introduction  shall  be 
given  here. 

With 

h(p,k)  :=  h(t/*k) 

the  dyadic  convolution  is  written  as  a  special 
case  of  the  generalized  convolution 

2n-l 

y(v)  =  2  h(tAsl')  x(k) 
k=0 

The  dyadic  shift  cpeiator  may  be  defined  as[l5] 

-  =  feoad  sied  •  *  *  *  •  ls2n-  i«kl 

The  dyadic  convolution  is  written  in  matrix 
notation  using  the  dyadic  convolution  matrix 


h(t/,k)  :=  htk-t/)  n 
mod  2 

we  call  this  system  a  circular  correlation  sys¬ 
tem.  The  shift  operator  is  represented  by  a 
unity  matrix  with  permuted  columns  defined  as 


=  ti  ©  x  =  Dyad(h^)  x 

because  of  the  commutative  operation  ®  the 
dyadic  convolution  matrix  is  symmetric  and 
dyadic  convoluticr.  and  correlation  are  the  same. 
The  dyadic  convolution  theorem  is  given  as 


The  convolution  matrix  is  a  circular  matrix 
and  the  cyclic  convolution  reads  as 

X.  ~  ii*  —  =  Cycl(h  )  x. 

The  similarity  transform  is  given  by  [ll] 

L  Cycl(h  )  _F  1  =  Uiag(h.) 

F  is  the  complex  Fourier-matrix  defined  as 


W  (h  ®  x)  =  h  •  x  =  v 

with  the  Walsh-similarity  transform 

W  Dvad(h  )  W-1  =  Diaq  (  h.  ) 

—  — —  v  ~  -  1 

where  W  is  the  real  Walsh  matrix  and  h  ,  ? 
are  the  Walsh  transforms 

W  =  W'  =  2n  W-1 
_h=Wh  x  =  W  x  =  W 


F  =  {exp  (  -j2irik/2n}} 


Dyadic  systems  have  not  the  same  physical 
interpretation  as  cyclic  systems  and  this  is 
why  not  all  applications  are  based  on  dyadic 
system  theory.  But  the  d  'a die  system  theory 
is  a  very  young  theory  and  there  exist  already 
interesting  applications.  The  main  reason  there¬ 
fore  is  given  by  the  Walsh  matrix  and  its  ex¬ 
cellent  properties.  There  exist  fast  transform 
algorithms  reduciny  the  required  operations 
from  2^n  to  n2n  and  in  Walsh  transformations 
only  additions  and  subtractions  are  required. 

We  are  now  interested  in  the  mutual  system 
transformation  of  dyadic  convolution  onto  cyclic 
Fourier  systems .  This  will  help  us  to  have  a 
better  understanding  of  the  dyadic  operations 
by  means  of  explaining  dyadic  systems  in  the 
discrete  Fourier  domain.  The  mutual  system 
mapping  is  given  by 


-Idyad  =  £"lj!  &&  ( V  * 
wn.i  the  system  transform 

B,d„  ■  £  Dado.,,)  r’ 


*W)  -2Te  e 


Generally  the  system  transformation  is  not  dia¬ 
gonal  because  dyadic  convolution  matrices  are 
only  diagonalized  by  Walsh-transform  and  not 
by  Fourier-transform.  Because  of  the  symmetry 
of  the  matrices  the  mutual  system  transform 
is  symmetric 


and  in  this  special  case  only  two  entries  out¬ 
side  the  diagonal  will  exist.  A  block  diagram 
of  the  dyadic  filter  in  the  Fourier  domain 
is  presented  in  figure  5.  FFT  and  iFFT  perform 
the  transformation  and  inverse  transformation 
with  fast  algorithms.  The  linear  transform 
and  the  non-diagonal  spectral  multiplication 
scheme  represent  the  proper  system  transfor¬ 
mation.  In  cyclic  convolution  the  block  named 
linear  transform  is  replaced  by  the  Fourier- 
transform  and  the  multiplication  scheme  is 
completely  diagonal.  We  see  now,  how  dyadic 
systems  are  to  be  described  in  the  Fourier 
domain:  additional  linear  combinations  are  re¬ 
quired  between  spectral  components. 


Figure  5.  Dyadic  convolution  in  the  discrete 
Fourier  domain 

Usiiig  the  Walsh  spectral  function  given  by 


”(d-*c)  ~ (d-*cl 


I 


W  h 


The  mutual  system  transformation  has 

only  2n  differing  elements  and 

p_ 

(2*2  -l)/3  zero  entries. 

For  n  =  2  the  transform  is  given  using  the  sys¬ 
tem  response  entries  h^,h^,h0,h^  by 

j[h0+h1+h^+h4)  0  0  0 

0  -172(1^-10  0  l/2(h0-h2)j 

H  -I 

I  o  0  fh0-h1+h3-h^  o 

0  l/2(hQ-h2)  0  j/2(h1-h3)j 


where  h  is  the  dyadic  system  response  the 
mapping  of  the  dyadic  convolution  system  reads 


iW;  " 


The  transform  of  the  circular  convolution  onto 
the  Walsh  domain  is  written  as 


-^cvcl 


— -  W  W  Cycl(h  )WWx 

,2n - v - 


with  the  mutual  system  mapping 

H(c.d)  —  WCM(hv)  w 


The  entries  of  the  transform  are  themselves 
linear  combinations  of  the  system  function  h 


The  transform  of  a  circular  matrix  yields  no 
diagonal  spectral  matrix,  but  only 

(22n+2)/3 

entries  are  differing  from  zero  and  also  2n 
are  only  different.  If  the  system  response  is 
a  real  function  the  system  transform  is  also 
a  real  matrix  and  no  complex  operations  are 
required  as  in  the  Fourier  mapping.  Using  fast 
Vhlsh  transforms  FWT  the  total  number  of  ope¬ 
rations  consisting  only  of  additions  and  sub¬ 
tractions  is  reduced  to  n2n.  An  algorithm  for 
this  transform  has  already  been  given  [l7] 
and  the  so-called  cyclic  fast  Walsh  convolution 
works  even  fastei  than  the  fast  Fourier  convo¬ 
lution. 

For  a  system  with  n=2  the  mutual  system  trans¬ 
form  is  written  as 

(h0,hl,h2‘h3)  0  0  0 

0  l/2(h  -hj  l/2(h  -h  )  0 

fj  o  2  13 

-(c-»d)'  o  -1/2(1^.  h3)  l/2(h0-h2)  0 

0  0  0  ww 

where  are  the  elements  of  the  sys¬ 

tem  response. 

Fourier  convolution  systems  are  often  described 
by  the  spectral  function  defined  as 


transform  and  the  diagonal  multiplication  of  the 
vector  components  the  system  turns  to  a  dyadic 
convolution  system. 


ha  hi  h2  h) 


Figure  6.  Cyclic  convolution  in  the  Walsh 
domain 

Conclusion 

Dyadic  and  cyclic  convolution  systems  are  only 
special  systems  under  a  generalized  theory. 

In  linear  systems  there  exist  close  relations 
between  different  systems  and  three  basic  map¬ 
pings  are  presented  here.  This  will  help  us  to 
understand  new  systems  by  well  known  ones  if 
we  map  the  new  systems  onto  classical  domains. 
The  mutual  mapping  will  also  give  us  new 
methods  for  the  realization  of  classical  tasks 
in  a  new  system. 


The  mutual  system  transform  using  the  spec¬ 
tral  representation  of  the  cyclic  system  is  Acknowledgement 

then  written  as 

j  ^  A  The  author  wishes  to  thank  Prof.  W.  Klein 

— (c-*d)  =  ~2~  —  —  PiagChp.)  F  W  for  stimulating  this  work. 


Figure  6.  shov's  a  block  diagram  of  the  cyclic 
convolution  mapped  onto  the  Walsh  domain. 

The  considered  systems  are  linear  and  the  ge¬ 
neralized  mapping  is  bilinear.  Therefore  the 
basic  rules  as  stated  in  the  mapping  of  a  dya¬ 
dic  convolution  onto  the  Fourier  domain  are  the 
same  in  the  other  case.  The  representation  of 
a  cyclic  convolution  system  in  the  Walsh  domain 
is  not  diagonal  and  additional  linear  combina¬ 
tions  between  spectral  components  are  required. 
If  we  replace  the  linear  transform  and  the  non- 
diagrnal  multiplication  scheme  by  the  Walsh 
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A  CLASS  OF  EFFICIENT  CONVOLUTION  ALGORITHMS 


Warren  F .  Davis 

Max-Planck-Institut  ftir  ftadioastronomie 
53  Bonn,  West  Germany 


Introduction 


Pitassi  [l]  has  described  an  effi¬ 
cient  algorithm  for  forming  the  cyclic 
convolution  (or  correlation)  of  sample 

sequences  of  length  N  =  2n.  Each  iter¬ 
ation  of  his  algorithm  requires  three 
sub-convolutions  of  sequences  of  length 
one-half  the  starting  length  for  that 
level  of  iteration.  The  total  number  of 
multiplications  is  thereby  reduced  from 

the  classical  value  of  N2  to  2*3n_1. 
Successive  halvings  at  each  level  of 
iteration  are  accomplished  by  pari- 
section  [2]  of  the  input  and  output  se¬ 
quences.  This  technique  is  remarkably 
similar  to  one  of  two  distinct  methods 
employed  in  the  derivation  of  the  FFT, 
decimation-in-timc  [3J  .  The  other  FFT 
method,  decimation-in-frequency,  in¬ 
volves  successive  halvings  by  bisec¬ 
tion. 


By  analogy  with  the  two  FFT  methods, 
efficient  cyclic  (periodic)  and  linear 
(aperiodic)  convolution  algorithms  can 
be  f'tund  by  the  methods  of  parlsection 
and  bisection.  Thus  Pitassi* s  algorithm 
is  a  member  of  a  more  general  class. 

All  algorithms  in  the  class  are  charac¬ 
terized  by  three  sub-convolutions  of 
half-length  sequences  at  each  leve’  of 
iteration.  Moreover,  these  algorithms 
are  more  efficient  than  FFT  convolution 
methods  when  suitably  short  partial 
results, are  required. 

Figure  1  is  a  schematic  representa¬ 
tion  of  the  general  form  taken  by  one 
iteration  cf  arv  of  che  ^algorithms  in 
the  class  ._Input  vector  x  enters  pla_ne 
A,  vector  y  plane  B,  and  the  output  r  is 
taken  from  plane  C.  The  three  character¬ 
istic  sub-convolutions  are  represented 
by  the  boxes  a,  b,  and  c  at  the  junction 
of  the  A,  B,  and  C-planes. 

The  complete  algorithm  for  the  gener¬ 
al  case  N  =  2n  is  obtained  by  itera¬ 
tively  substituting  a  form  similar  to 
Figure  1,  but  of  half-length,  into  each 
sub-convolution  box.  The  algorithm  is 
complete  vrtien  convolutions  oi  length 
one  are  finally  required.  We  shall  spe¬ 
cify,  in  the  derivations  which  follow, 
the  specific  flow  which  must  comprise 
planes  A,  B,  and  C  for  each  technique. 


Figure  1.  The  general  form  of  one  iter¬ 
ation  of  the  algorithms  in 
the  class.  The  flow  in  the  A, 
B,  and  C-planes  is  specific 
to  the  kind  of  convolution 
and  the  method  of  derivation. 


Operators  and  Notation 


Sequences  to  be  convolved  are  as¬ 
sumed  to  be  of  length  N  =  2n.  They  will 
be  represented  by  column  vectors,  de¬ 
noted  by  overbar,  with  element  indices 
in  the  range  0,1,... N-l.  For  example. 


The  cyclic  convolution  of  two  se¬ 
quences  x  and  y  will  be  denoted  by  ©  . 
If  T  **  >.  ®Y,  then 


K-i 

rk  ~p^0Xp  y(p+k)mod  N 


U) 
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(k=0,l,...N-l) 


®  «  «  +  (3 


(4) 


Linear  convolution  will  be  denoted  by  •, 
If  7  ■  x  »  y,  then 


Figure  2  illustrates  these  three  con¬ 
volutions  for  the  case  K  *=  4.  It  is 
clear  from  the  figure,  and  can  be  ver¬ 
ified  from  (1),  12),  and  <3) ,  that 


rC  rl  r3  ~3 


Figure  2.  Cyclic  (a;,  linear  (b) ,  and 
complementary  (o_)  convolu¬ 
tions  of  x  and  y  for  N  =  4. 
The  i^th  element  of  the  re¬ 
sult  r  is  the  era  of  oroducts 
between  the  element*;  of  7  and 
horizon  tally  opposed  eleir.er.tr 
of  x  iu  the  i-th  column. 


Cyclic  Convolution 
Method  of  Bisection 

The  input  uequenccs  jc  and  y  and  the 
output  sequence_r  in  the  cyclic  convo¬ 
lution  r  =  x®y  can  be  partitioned 
into  upper  and  lower  parts. 

Lr  “  Lx  «  Ly  +  Ux  »  Uy  +  Lx  E  Uy 

+  US  ?»j  by 

(6) 

Ur  Lx  «  U?  +  U3t  »  Ly  +  L5c  {#]  Ly 

+  Ux  @  Uy 

The  origin  of  oach  term  of  (6)  is 
clearly  associated  with  one  of  the  tri¬ 
angular  areas  shown  in  the  example  of 
Figure  3.  Each  term  may  be  formally 
verified  from  the  definitions  (l)-(5). 
Ir.  the  subsequent  derivations  we  shall 
again  use  only  the  operator  notation 
and  visual  term  identification  provided 
by  a  partitioned  diagram  such  as  Figure 
3.  In  every  ca°e  the  validity  of  the 
operator  equa*.  on  can  be  verified  for 
t.1]  positive  n  from  the  fo.mal  defini¬ 
tions  . 


S19 


«  XS  I  x4\x3  *2  *1 

7  x4  I  *S  x4^x3  *2 

CSX7  j  x«  X5  XN»3 


than  one  way  to  decompose  the  original 
convolution  into  three  sub-convolutions 
Each  decomposition  leads  to  a  distinct 
algorithm. 

Figure  4  illustrates  one  iteration 
in  the  A,  B,  and  C-planes  according  to 


x,  I  x 


Figure  3.  Decomposition  of  cyclic  con¬ 
volution  r  »  x  ®  y  by  bisec¬ 
tion  for  the  case  N  =  8. 


If  the  operator  identity  (4)  is  used 
to  eliminate  che  complementary  convolu¬ 
tions  0  in  (6) , 

Lr  =  (LX  -  Ux)  •  (Ly  -  Uy) 

+  LR  ®\jy  +  UR  ®  Ly 

(7) 

Ur  -  - (Lx  -  Ux)  •  (L7  -  Up) 

+  LR  ®  L?  +  UR  ®  Uy 


Relations  (7)  can  be  expressed  in  terms 
of  three  sub-convolutions  of  sequences 
of  length  N/2.  Let 

a  -  (Lx  +  Ux)  ®  (Ly  +  Up) , 

b  *•  (Lx  -  Ux)  ®  (Ly  -  U7)  ,  (8' 

c  «  (LR  -  UR)  •  (Ly  -  UP) , 

then 

Lr  *  c  +  1/2  (a  -  b) , 

Ur  =  -c  +  1/2  (5  +  E) .  (9) 

Alternatively,  (4;  can  be  used  to 
eliminate  the  linear  convolutions  •  in 
(6)  and  sub-convolutions  defined, 

d  *  (Lx  +  Ux)  ®  (Lp  +  Uy)  , 

5  “  (LR  -  Ux)  ®  (Ly  -  Up) ,  (10) 

f  »  (Lx  -  Ux)  0  (L7  -  U?)  , 

so  that 

Lr  -  1/2  (3  +  e)  -  f  , 

Uf  -  1/2  (d  -  5)  +  7  .  {11) 

Results  (S)  and  (10)  illustrate  that  for 
each  convolution  type,  cyclic  or  linear, 
and  each  derivational  method,  bisection 
or  parisection,  there  is  generally  more 


Figure  4.  One  iteration  of  the  algorithm 
for  cyclic  convolution  by  bi¬ 
section  according  to  (8)  and 
(9)  for  F  o  6.  Broken  lines 
indicate  .legation.  The  scale 
factor  X/‘i,  shown  adjacent  to 
the  appropriate  lines,  can  be 
accomplished  by  shifting. 


(8)  and  (9)  for  the  case  N  ■  8.  To  iter 
ate  further  we  must  employ  the  linear 
convolution  aloorithm  derived  below. 
Figure  5  illustrates  the  complete  A,  B, 
and  C-planes  of  the  algorithm  for  N  =  8 
Bit-reversal  cf  thi  order  of  sequences 
must  be  introduced  in  the  complete  al¬ 
gorithm  at  the  transitions  between 
cyclic  sub-convolutions  by  bisection 
and  linear  sub-convolutions  by  pari- 
section.  There  is  no  algorithm  within 
the  class  for  linear  convolution  by  bi¬ 
section.  Hence  the  algorithm  shown  in 
Figure  5  is  an  hybrid  of  the  bi-  and 
parisection  methods. 

Method  of  Parisection 


The  input  and  output  sequences  of  the 
cyclic  convolution  F  -  5?  ®  y  may  like¬ 
wise  be  partitioned  into  equal  croups 
accordino  to  the  index  parity  of  the 
elements  of  the  sequences. 

EF  =  E5c  ®  Ey  +  05c  @07 

(12) 

OF  -  05c  ®  (Ey)  '  +  E5?  ®  07 

This  is  illustrated  in  Figure  6.  The 
prime  denotes  a  cyclic  shift  of  the  el¬ 
ements  of  the  sequence.  If  v  is  of 
length  M  and  z  »  (7) ' ,  then 


zk  *  v(k+l)mod  M 


(k«0,l,...M-l) 


For  the  case  U  »  8. 


Boxes  labelled  2M  and  3M  have  two  out 
puts  each  to  the  C-plune  and  perform 
two  and  three  multiplications,  re¬ 
spectively. 


OVfWI-C  |  J(Oob0*o,b,l  JlOolyo,  b,l 


OUTfVf-1  |  }lo0b„- 


Figure  5.  Cyclic  convolution  by  bisec¬ 
tion  for  the  case  N  »  8.  The 
basic  iteration  is  from  (8) 
and  (9) ,  but  the  algorithm 
for  linear  convolution  by 
parisection  must  be  intro¬ 
duced  to  complete  the  flow. 


:o\%  x4 


M 


v, 


M 


xoVe  I  x3 


in  (14)  to  rewrite  c. 

c  =  (Ox  ®  Ey)  '  -  Ox  ®  E7  .  ( 

This  is  simply  the  slipping  algorithm 
applied  tc  05?  ®  Ey .  Figures  9  and  10 
il^istrate  one  iteration  and  the  com- 


Figure  6.  Decomposition  of  cyclic  con¬ 
volution  F  =  5?  ®  7  by  pari- 
sectlon  for  N  =  8. 

If  we  choose  the  sub-convolutions 

a  °  (E5?  +  05?)  ®  (E?  +  0?)  , 
b  **  (E5?  -  05?)  ®  (E?  -  0?)  ,  (1 

S  ■  05c®  [(E?)  '  -  Ey ]  , 


EF  *  1/2  (a  +  b) , 

Or  =»  1/2  (a  -  b)  +  c.  (15) 

Figure  7  illustrates  one  iteration  ac¬ 
cording  to  (14)  and  (15) ,  and  Figure  8 
the  complete  algorithm,  for  N  <*  8.  Pari- 
section  results  in  bit-reversed  input 
and  output  sequences  in  the  complete 
algorithm.  We  shall  call,  the  operations 
which  can  be  identified  with  (Ey) ’  -  Ey 
in  c  at  each  level  of  iteration  a  "slip¬ 
ping"  algorithm.  It  is  seen  clearly  at 
the  input  to  c  on  plane  B  of  Figure  7. 
Bit-reversed  sequences  in  the  complete 
algorithm  necessitate  performing  the 
slipping  algorithms  at  all  levels  of 
iteration  in  bit-reversed  order.  Though 
the  flow  of  the  bit-reversed  slipping 
algorithm  appears  unacceptably  complex, 
it  in  fact  can  be  performed  simply  and 
in-place  as  described  in  Appendix  A. 

The  corrections  c  are  not  required 
for  cyclic  convolution  of  sequences  of 
length  2  and  hence  they  do  not  appear  in 
the  inputs  to  the  multipliers  2M  in  Fig¬ 
ure  8.  Matters  are  further  simplified  at 
the  final  level  of  iteration  because  the 
slipping  algorithm  (v) '  -  v  is  degener¬ 
ate  for  length-2  sequences.  Consequently 
the  mid-multiplier  of  each  group  of 
three  in  Figure  8  is  of  the  type  1M. 

An  alternate  algorithm  for  cyclic 
convolution  by  parisection  is  derived 
using  the  identity 


■1 

Mi 


A — H 


Figure  7.  One  iteration  of  the  algorithm 
for  cyclic  convolution  by 
parisection  according  to  (14) 
and  (15)  for  N  *=  8. 


plete  algorithm  for  N  =  8  based  on  a  and 
b  from  (14)  and  c  from  (16) . 


This  algorithm  is  in  fact  that  chosen 
by  Pitassi  for  illustration.  As  he 
showed,  it  has  the  advantage  that  the 
outputs  of  the  A  and  B-planes  can  be 
simply  related  to  the  Walsh  transforms 
of  x  and  7  with  commensurate  savings  of 
storage . 


Linear  Convolution 


Method  of  Parisectlon 


Figure  11  illustrates  the  linear  con¬ 
volution  r  =  1?  »  7  by  parisection  for 
N  =  8.  The  corresponding  relations  are 


Er  =  Ex  #  E7  +  Ox  •  07  , 

Or  -  Ox  »  (Ey) "  +  Ex  •  Oy  .  (17 

Double  prime  denotes  a  shift  of  the  el¬ 
ements  of  a  sequence,  with  zero  filling 
the  vacated  position.  If  v  is  of  length 
M  and  z  =  (7) " ,  then 

\  *=  vk+1  ,  (k=0, 1 , . .  .M-2) 

ZM-1  =  0  * 

For  the  case  N  =  8, 


We  may  choose  sub-convolutions  anal¬ 
ogous  to  (14)  by  replacing  ®  by  »  and 
'  by  "  . 


a  =  (Ex  +  Ox)  o  (E7  +  Oy)  , 
b  =  (Ex  -  Ox)  »  (Ey  -  07)  ,  (18) 

c  =  Ox  »  £(Ey) "  -  EyJ  . 


Boxes  labelled  1M  have  two  outputs  to 
the  C-Dlane  and  perform  one  multipli¬ 
cation. 


aiWT-o  Kb,- 
amajr-'  |»oarv. 


Figure  8.  Cyclic  convolution  by  pari¬ 
section.  Complete  A,  B,  and 
C-plane  flow  using  (14)  and 
(15)  for  the  case  N  *  8. 


Figure  9.  One  iteration  of  the  algorithm 
for  cyclic  convolution  by 

farisection  according  to  a  and 
from  (14)  and  c  from  (16) 
for  the  case  N  ■  8. 


Figure  10.  Cyclic  convolution  by  pari- 
section.  Complete  A,  B,  and 
C-plane  flow  using  a  and  b 
from  (14)  and  c  from  (16)  for 
N  =  8.  Note  the  simplifica¬ 
tion  of  the  slipping  algor¬ 
ithm  at  the  output  of  multi¬ 
pliers  2,  5,  and  8  in  the 
C-plane . 


Dower  of  3  in  all  of  the  algorithms. 
There  can  be  as  many  iterations  as  the 
number  of  times  the  input  sequences  can 

be  halved.  If  N  =  2n,  3n_1  sub-convolu¬ 
tions  of  length  2  are  required  in  the 
completed  algorithm.  One,  two,  or  three 
[generally  complex]  multiplications  are 
required  by  each  such  sub-convolution. 
The  multiplications  will  be  real  if  the 
sequences  to  be  convolved  are  real. 

The  final  sub-convolutions  for  linear 
convolution  by  parisection  all  require 
3  multiplications  (Figure  12} ,  so  that 
the  total  number  of  multiplications  is 


Figure  11.  Decomposition  of  linear  con¬ 
volution  r  =  x  »  y  by  pari¬ 
section  for  N  =  8. 


Or,  we  may  use  the  identity 


V  •  (v) "  =  (w  *  v) " 


to  rewrite  c. 


c  =  (Ox  »  Ey) "  -  Ox  »  Ey  .  (19) 

In  either  case,  (15)  applies. 

The  form  (v) "  -  v  is  a  slipping  al¬ 
gorithm  with  the  main  (logically  for¬ 
ward)  diagonal  removed.  Hence,  one-iter¬ 
ation  diagrams  analogous  to  Figures  7 
and  9  apoly,  but  with  ©  replaced  by  » 
and  the  slipping  algorithm  main  diagonal 
removed.  Figure  12  illustrates  the  com¬ 
plete  algorithm  based  on  (15)  and  (18) 
for  N  =  8.  Note  that  three  multiplica¬ 
tions  are  required  per  linear  sub-convo¬ 
lution  of  length  two  and  that  the  modi¬ 
fied  slipping  alaorithm  in  the  final 
stage  of  iteration  does  not  simplify  as 
for  cyclic  convolution. 

Method  of  Bisection 


Figure  13  illustrates  the  partition¬ 
ing  of  the  linear  convolution  r  =  x  #  y 
by  bisection.  The  relevant  equations  are 

Lr  =  Lx  »  Ly  +  Lx  @  Uy  +  Ux  «  Uy  , 

(20) 

Or  =  Lx  «  Uy  . 


mm 


Evidently  these  equations  can  not  be  re¬ 
duced  to  simple  combinations  of  three 
sub-convolutions . 

Number  of  Multiplications 

Each  level  of  iteration  increases  the 
total  number  of  sub-convolutions  by  a 


Figure  12.  Linear  convolution  by  pari¬ 
section.  Complete  A  and  B~ 
plane  flow  using  (15)  and 
(18)  for  the  case  N  =  8. 

Plane  C  is  as  shown  in  Figure 
8  for  cyclic  convolution,  but 
with  all  multipliers  of  the 
3M  type. 


Lr  Ur 


Figure  13.  Decomposition  of  linear  con¬ 
volution  r  =  x  #  y  by  bisec¬ 
tion  for  the  case  N  =  8. 

3n.  Cyclic  convolution  by  parisection 
can  be  performed  in  two  ways.  If  the 
slipping  algorithms  are  in  the  C-plane, 
all  final  sub-convolutions  require  2 
multiplications  (Figure  10) .  The  total 

number  is  therefore  2-3n_1.  If  the  slip¬ 
ping  algorithms  are  in  the  B-plane  (Fig¬ 
ure  8) ,  the  mid-convolution  in  each 
group  of  three  will  require  only  one 
multiplication,  so  the  total  number  is 

reduced  to  5*3n  2. 

At  each  level  of  the  hybrid  algorithm 
for  cyclic  convolution  by  bisection 
(Figure  5) ,  the  number  of  sub-convolu¬ 
tions  of  the  cyclic  type  increases  by  a 
power  of  2.  In  the  complete  algorithm 

there  are  2n  1  cyclic  sub-convolutions 
of  length  2,  each  requiring  2  multipli¬ 
cations.  The  remaining  3n-1  -  2n_1  sub¬ 
convolutions  are  of  the  linear  type  re¬ 
quiring  3  multiplications.  The  total 
number  of  multiplications  is  therefore 

3n  -  2n  1.  These  results  are  summarized 
in  Table  1  below. 

Linear  convolution  can  be  effected 
via  a  double-length  cyclic  convolution 
padded  With  zeros.  Table  1  reveals  that 


Conv. 

Mult. 

Method 

Relevant  Eq. 

eye 

5«3n~2 

parisect 

(14)  ,  (15) 

eye 

2*3n_1 

parisect 

(14),  (15),  (16) 

eye 

3n_2n-l 

bisect 

(8)  , (9) 

lin 

3n 

parisect 

(15)  .(18) 

Table  1.  Summary  of  convolution  algor- 
i thms . 


linear  convolution  using  (15)  and  (18) 
is  superior. 

Partial  Convolution 


The  algorithms  by  parisection  are  ad¬ 
vantageous  when  only  a  segment  of  the 
complete  convolution  is  required,  if  the 
slipping  algorithms  are  not  in  the  C- 
plane.  Let  us  assume  that  the  first 

M  =  2:n  points  of  the  convolution  are  to 
be  evaluated  (m  <  n) .  Inspection  of  Fig¬ 
ures  7  and  8  reveals  that  sub-convolu¬ 
tions  yielding  the  first  2m  1  points  are 
required  at  the  first  level  of  itera¬ 
tion.  At  the  k-th  level  of  iteration, 

3‘  sub-convolutions  of  sequences  of 

length  2n  ^  are  required  yielding  2In  ^ 
points.  When  k  =  m,  each  sub-convolution 
must  yield  only  its  first  point.  If  each 
point  required  at  the  k-th  iteration 
level  is  evaluated  in  the  straightfor¬ 
ward  way,  N(3/2)m  multiplications  are 
involved.  This  number  is  less  than  that 
required  for  full  convolution  by  pari¬ 
section,  except  for  ~vcl:c  convolution 
using  (14)  and  (15)  •  s  no  excep¬ 

tion  if  m  <  n  1. 

Thus  parti.  _  cycli  mear  convo¬ 

lutions  based  on  equations  (14)  ,  (15) , 
and  (18),  using  algorithms  tailored  as 

described  above,  all  require  N(3/2)m 
multiplications.  Partial  cyclic  and  lin¬ 
ear  convolutions  using  the  FFT  technique 
can  be  evaluated  in  approximately 
2N(n+m+4)  -  4M  and  4N(n+mh5)  -  4M  real 
multiplications  respectively  (m  <  n) . 
These  estimates  can  be  improved  slightly 
with  careful  programming.  It  is  assumed 
that  each  stage  of  the  inverse  transform 
leading  to  the  partial  convolution  is 
evaluated  only  to  the  extent  required 
for  partial  results.  Linear  convolution 
by  the  FFT  method  is  assumed  to  be  ac¬ 
complished  by  a  full  doubling  of  the  in¬ 
put  sequences  by  zero-padding,  though 
less  would  suffice  for  partial  results, 
because  one  can  not  otherwise  easily 
predict  the  prime  factors  of  the  new 
sequence  length. 

The  algorithms  described  here  for 
partial  cyclic  and  linear  convolution 
require  fewer  multiplications  than  the 
FFT  technique  for  suitable  combinations 
of  m  and  n.  Table  2  lists,  using  the 
above  estimates,  some  partial  convolu¬ 
tion  lengths  M  and  the  corresponding  in¬ 
put  seauence  lengths  N  for  which  partial 
convolution  can  be  evaluated  more  effi¬ 
ciently,  in  terms  of  real  multiplica¬ 
tions,  than  with  the  FFT.  It  is  assumed 
that  the  input  sequences  are  real  so 

that  the  new  algorithms  require  N(3/2)ro 
real  multiplications. 
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M 

N 

2k 

&2k+1, 

(k<9  ,  cyclic  cor.v.) 
(k<ll,  linear  conv.) 

2“0 

in 

H 

A1 

cyclic  conv. 

21 1 

S229  , 

cyclic  conv. 

212 

£249  , 
2:216  , 

cyclic  conv. 

linear  conv. 

Table  2.  Some  trade-off  values  for  par¬ 
tial  convolution  using  the  new 
algorithms.  See  text  for  expla¬ 
nation. 

The  new  algorithms  are  particularly 
advantageous  in  applications  which  re¬ 
quire  convolution  (or  correlation)  of 
very  long  sequences,  but  in  which  only 
the  first  relatively  few  terms  of  the 
convolution  are  required.  One  such  ap¬ 
plication  is  the  estimation  of  the 
power-density  spectrum  of  noise  from  its 
autocorrelation . 


the  corresponding  nodes  in  the  output  of 
the  A  and  B-planes.  Super  »  indicates 
that  the  corresponding  column  vector  is 
to  be  placed  in  bit-reversed  order. 

If  the  flow  associated  with  y  at  all 
levels  of  iteration  is  eliminated,  the 
A  and  B-planes  reduce  to  the  flow  pat¬ 
tern  of  Shanks'  algorithm.  The  input  se¬ 
quence  is  in  natural  order  for  convolu¬ 
tion  algorithms  proceeding  by  bisection, 
and  in  bit-reversed  order  for  those  by 
parisection.  The  latter  is  equivalent  to 
the  canonical  form  of  Shanks'  algorithm 
discussed  in  Appendix  B. 

Shanks'  algorithm  yields,  in  bit- 
reversed  order,  the  Walsh  coefficients 
of  a  naturally  ordered  input  sequence. 

SB  *  (Wl)* 

where  W  is  the  Walsh  transform  operator. 
In  Appendix  B  we  show  that  Shanks'  al¬ 
gorithm  applied  to  a  bit-reversed  se¬ 
quence  yields  the  Walsh  coefficients  in 
natural  order. 


Relation  to  Walsh  Transform 

Inspection  of  the  complete  A  and  B- 
plane  diagrams  for  all  algorithms  in  the 
class  reveals  four  basic  flow  patterns. 
The  slipping  algorithms,  whiv  appear  in 
the  derivations  by  parisectior. ,  can  al¬ 
ways  be  transferred  from  the  B  to  the  C- 
plane  as  previously  shown  and  so  are  not 
considered  here. 

The  rectangles  in  Figure  14  signify 
that  the  associated  nodal  variables  are, 
in  general,  column  vectors  of  length 
greater  than  one.  S  is  Shanks'  algorithm 
[4]  of  the  appropriate  order  for  compu¬ 
ting  the  Walsh  transform.  The  arrows  =£> 
indicate  the  transformations  which  are 
applied  to  the  nodal  variables  to  yield 


(b) 


id) 


SB*  =  WB  =  (SS)* 

The  nodes  in  the  output  associated 
horizontally  with  7  at  any  level  of  it¬ 
eration  can  be  derived  from  the  much 
smaller  set  of  nodal  values  produced  by 
Shanks'  algorithm  applied  to  the  input 
sequence.  Hence  the  convolution  algor¬ 
ithms  can  be  implemented  with  great 
savings  of  storage.  For  parisection  (see 
Figure  14) 

a  =  S  +  oi  ,  3  =  6  -  w 

from  which 

£  =  1/2  (a  -  S)  ,  Su  =  1/2 (Sa  -  SB)  , 

_  (21) 
6  =  1/2 (a  +6),  S6  =  1/2 (Sa  +  SB). 

For  bisection  we  need  only 

SB*  =  (SB)*,  Sa*  =  (Sa)*  .  (22) 


Sa  and  SB  are  available  as  sub-sequences 
of  the  N  nodal  values  produced  by 
Shanks'  algorithm.  Su,  S6,  SB*,-  and  Sa* 
can  be  computed  from  Sa  and  SB  as  needed 
using  (21)  and  (22) . 


aendix  A 


Bit-reversed  Slit 


Algorithm 


Figure  14.  Basic  A-olane  (a,b)  and  B-  The  slipping  algorithm  can  be  per- 

plane  (c,d)  flow  patterns  formed  in  bit-reversed  order  in-place 

occurring  in  the  derivations  and  without  an  extra  storage  array.  For 

by  parisection  (a,c)  and  by  the  case  N  =  8  the  steps  are 

bisection  (b,d) . 
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- -70  v0‘ 

V7‘=V0-V7 

vi  oA~ 

-/  /  Vl 

V3'=V7-V3 

v5‘=  v3-vs 

v3  °Sc 

v3 

Vi‘=v5-v, 

V6  =  V1-V6 

v2'=  V6-V2 

- -^>  Vg 

V4=V2-V4 

V7c4  — 

v0'=  v4-v0 

Figure  Al. 

Slipping  algorithm  in  bit- 
reversed  order  for  the  case 

N  =  8. 

The  first  step  is  simply  =  -v^  if  the 

slipping  is  applied  to  a  linear  convolu¬ 
tion.  If  the  steps  are  performed  in  the 
order  indicated,  only  one  word  is  re¬ 
quired  to  temporarily  store  the  previous 
contents  of  the  register  just  over¬ 
written.  The  required  indices  are  just 
the  bit-reversed  integers  in  reverse 
order.  They  can  be  generated  as  follows. 

Integers  are  represented  by  an  n-bit 
word.  Begin  with  an  n-bit  word  of  l's 
(N  -  1) .  This  is  the  first  required  in¬ 
dex.  The  next  index  is  found  by: 


N-l  N-l  n-1  m  ,  ,k, 

6k  "I  « mWmk  -l  «m  "  ° 

m=0  m=-0  i=0 


(k=0, 1 , .  .N-l) 


W  ,  is  the  mk-th  element  of  the  matrix 
nx 

representing  che  Walsh  transform,  m 
and  k^  are  the  i-th  digits  of  the  n-bit 
binary  representations  of  m  and  k. 


m  =  2n  1m  -+2n  2m  0+ . +2m.+m/- 

n-l  n-2  10 


k  =  2n-1k  ,+2n-2k  ,+ . +2k.+k- 

n-l  n-2  1  O 


With  super  »  representing  bit-reversed 
order,  it  is  clear  that 

N-l  n-l  m, k, 

ek  =  l  a*  H  (-1)  1  (B4 

K  in=0  m  i=0 


and  also  that 


a)  l's  complementing  the  loft-most 
1  in  the  n-bit  word. 

b)  l's  complementing  any  zeros  which 
may  have  existed  to  the  left  of 
the  bit  position  complemented  in 
a)  . 


Subseauent  indices  are  generated  by  ap¬ 
plying  steps  a)  and  b)  to  the  most  re¬ 
cent  index.  The  process  is  repeated  un¬ 
til  zero  results.  This  procedure  is  par¬ 
ticularly  convenient  in  machines  with 
normalizing  and  arithmetic  shift  in¬ 
structions. 


ppendix  B 


Shanks'  algorithm  applied  to  a  bit- 
reversed  sequence  yields  the  Walsh  coef¬ 
ficients  of  the  sequence  in  natural 
order.  To  show  this  we.  first  show  that 
the  Walsh  transform  of  a  bit-reversed 
sequence  is  the  Walsh  transform  in  bit- 
reversed_order .  Let  the  Walsh  transform 
of  a  be  B. 


S  =  Wa 


(Bl) 


The  elements  of  B  are 


Figure  Bl.  a)  Shanks'  algorithm  S  for 
Walsh  coefficients  when 
N  =  8. 


b)  Canonical  form  of  Shanks' 
algorithm  S'  for  N  =  8. 


(B5) 


associated  nodes  are  to  remain  so.  There 
will  result 


F-l  n-1  m.k  ,  , 

£  -  l  a*  n  :-n  n"1_i 

K  m=0  r  i=0 


S' a  *»  Wa*  =>  Sa 


(B9) 


Introduce  the  change  of  variable  p  = 
n-l-i , 


.  N-1  .  n-1 

Bk  =  l  am  n  ‘“D 

K  rc=0  m  p=0 


m  ,  k 
n-l-p  p 


(B6) 


S'  is  the  canonical  form  of  Shanks’  al¬ 
gorithm  which  bears  a  relation  to  S 
similar  to  that  between  the  canonical 
forms  of  the  FFT  [3]  . 
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Abstract 

We  consider  the  use  of  (n,k)  binary  gr^up 
codas  over  a  channel  from  the  viewpoint  of  a 
mean-square  error  criterion.  It  is  assumed  that 
the  transitions  probabilities  of  the  channel 
satisfy  an  additive  property.  The  elements  of  a 
generic  code  are  labeled  by  the  first  2 ^  nonneg¬ 
ative  integers,  0,1,  ...,  2^-1,  so  as  to  obtain 
integer-valued  landc-a  variables  at  the  input  and 
output.  Optimum  performance  is  judged  by  the 
meen-squate  of  the  overall  error  between  input 
and  output.  3ased  upon  this  criterion  the  opti¬ 
mum  linear  encoding  and  decoding  rules  as  well 
as  the  optimum  group  code  are  determined  simul¬ 
taneously. 

Our  analysis  and  synthesis  uses  the  Wa’ah 
transforms  of  the  channel  transition  probabili¬ 
ties.  It  is  shown  that  the  optimum  rules  and 
code  are  completely  specified  by  k  linearly  in¬ 
dependent  V.'alsh  functions  defined  on  the  binary 
n-dimengional  vector  space.  Unfortunately  the 
most  significant  pact  of  this  result  is  that  'he 
optimum  rules  are  always  projection  mappings, 
i.e.,  rules  which  use  none  ot  the  rerity-check 
positions. 

introduction 

'Chi11  paper  presents  the  development  of 
classes  of  algebraic  codes  using  the  Walsh  ana  i- 
ysis  of  the  statistics  of  the  system  in  which 
they  are  to  be  employed.  This  approach  adds  to 
the  algebraic  one  the  dimension  of  Fourier  anal¬ 
ysis.  As  in  the  recent  articles  by  Cvitwnins, 
et.  ’.1.  ,  [1]  and  Crimmins  and  Horwitz  [2]  we 
will  use  the  mean-square  of  the  overall  error 
as  a  criterion  of  goodness.  However  unlike 
either  of  these  papers  the  minimization  of  this 
criterion  wi 1 1  also  dictate  the  linear  code  as 
well  as  the  linear  encoding  and  decoding  ru  es 
to  implement  it.  Our  results  have  a  negative 
aspect  to  then  in  that  the  optimum  rule?  are 
just  projection  mappings.  This  is  undesirable 
for  coding  purposes  since  projection  mappings 
are  equivalent  to  rules  which  do  net  use  the 
oarity-check  positions  in  a  code. 


A  model  of  the  system  which  we  will  consider 
is  shown  in  the  figure.  The  source  alphabet 
•rill  be  taken  as  the  set  of  the  *'rst  2^  non¬ 
negative  intergers,  i.e.,  S«tO,l, . . . ,2^-1} .  The 
purpose  of  this  choice  of  a  source  set  Is  to 
give  real-valued  random  variables  for  use  in 
the  mean-square  error  criterion.  The  encoder 
mechanizes  the  mapping  rule  Ag""1  ("he  meaning 
of  the  subscript  and  superscript  will  be  clear 
shortly)  and  transforms  the  message  (an  integer 
from  S)  into  a  member  of  an  n-dimensional  binary 
vector  space  V.  Since  we  are  seeking  a  linear 
code,  every  member  of  S  is  carried  onto  a  mem¬ 
ber  cf  some  k-dimensional  subspace  G  of  V.  At 
this  point  we  may  only  hypothesize  the  existence 
of  such  a  code  G;  its  exact  specification  is  to 
be  determined  below.  Clearly  this  mapping  A„ 
must  be  in  a  one-tc-one  fashion  for  otherwise 
the  decoder  which  reverses  this  operation  would 
be  cur.f  ronted  with  ambiguities .  The  inverse  of 
the  encoding  rule  is  a  rule  Ag  which  is  one-to- 
one  from  the  subspace  G  onto  S. 

The  statistical  effects  of  the  channel  can 
transform  a  symbol  from  G  into  a  member  of  V 
which  is  not  in  the  subspace  G.  Therefore  the 
decoder  involves  a  rule  A  which  maps  from  V 
back  into  the  source  set  C.  Since  the  decoder 
must  reverse  the  action  of  the  encoder,  the  map¬ 
ping  Ag-1  must  be  the  inverse  oi  the  decoder 
rule  A  when  it  is  restricted  to  act  only  or.  the 
subspace  G.  The  purpose  of  the  subscript  and 
superscript  in  Aq"1  is  now  clear. 

Thus  the  problem  is  to  find  the  mapping  A 
such  that  a  minimum  mean-square  error  Is 
achieved.  In  turn,  the  mapping  A  defines  the 
subspace  G,  the  linear  block  code.  Our  approach 
will  use  the  Fourier  transforms  of  the  channel 
transition  probabilities.  However  the  character 
group  of  the  binary  vector  space  V,  i.e.,  the 
kernels  for  the  transforms ,  are  exactly  the 
first  2n  Waleh  functions  suitably  defined  on  V. 
Therefore  the  abstract  Fourier  transforms  be¬ 
come  the  Walsh  transforms. 
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:my  of  the  well  known  properties  of  the 
•’  '  Transforms  will  be  used  throughout  this 

paper.  Also  since  the  subject  of  Abstract 
Fourier  Analysis  is  well  covered  in  several 
books  [ 3-6 ] ,  we  will  use  standard  notation  and 
terminology  without  specific  reference. 

We  will  introduce  several  additional  svm- 
bols.  The  set  S  which  was  defined  as, 

S  =  {0,1, . . . ,2^-J }  will  also  be  endowed  with  an 
additive  operation  (?)  which  is  dyadic  addition 
(component-wise  modulo  2  addition  -  no  carries). 
V  is  an  n-dimensional  binary  vector  space  with 
character  group  V  .  G  is  a  k-dimensional  sub¬ 
space  of  V  with  annihilatcr  A*,  i.e., 

A*  =  (xeV*:x(g)  “  1  for  ail  geG}.  If  f(v)  is  a 
complex  valued  function  on  V,  its  transform  is; 

f(x)  ■  [  f(v)  x  (v)  ;  x;v*  (l) 

veV 


The  main  result  is  contained  in  the  follow¬ 
ing  theorem 

Theorem:  The  necessary  and  sufficient  conditions 
for  a  linear  mapping  A:V->-S  which  is  an  isomor¬ 
phism  on  a  k-dimensional  subspace  G  to  achieve 
a  minimum  mean-square  error  over  all  possible 
choices  of  such  mappings  and  k-dimensionsl  sub¬ 
spaces  are  given  as: 

There  is  a  set  of  linearly  independent 
characters  satisfying  the  conditions. 


(Ker  Xj> 


(1  - 


The  sum  is  over  all  2  '  elements  of  V.  The  In¬ 
verse  transform  is: 

f(v)  »  I  f Cx)  x(v)  ;  veV  (2 

2n  XeV* 

This  sum  is  over  all  2n  elements  of  V*. 

We  will  assume  that  the  probability  dis¬ 
tribution  of  the  source  is  uniform,  i  e., 

p(s)  -  for  all  seS.  We  will  further  assume 
2* 

that  the  channel  transition  probabilities  are 
given  and  that: 


iii)“  P(Xl)  >  P(6) 


P(v  |g)=>P(v-g|0)  g;G,  veV,  0  =  identity  (3 

The  following  lemma  gives  a  characteriza¬ 
tion  of  the  class  of  mapping  rules  of  the  de¬ 
sired  type.  In  this  lemma  we  also  distinguish 
the  subclass  of  projection  mappings,  i.e., 
linear  mappings  which  always  take  some  basis 
elements  of  V  into  zero.  A  projection  mapping 
is  equivalent  to  a  rule  which  does  n..t  use  all 
available  parily-check  positions  in  a  code. 


There  Is  a  linear  mapping  A:V-*  5  whose  re¬ 
striction  to  a  subgroup  G,  >._,  is  an  isomorphism 
if  and  only  if  there  is  a  basis  far  v*/A*, 

and  a  basis  for  A*,(Xj)j=^+^  and  binary 

constnts  a^j  ■  0,  1,  where  I  <  i  <  k,  and 
k+1  <  j  e  n  sucli  that 


k  . 

A  -  I2K 
1*1 


1  -  X, 


For  a  given  G,  this  representation  is  unique. 
Furthermore  A  Is  also  a  projection  mapping  tak¬ 
ing  m  basis  elements  of  V  into  zero  if  and  only 
if  there  are  m  indices,  jj,  j2>  ....  jra,  for 
which  as.  “0  for  all  i  =  1,2,  ...,  k. 

The  proof  of  this  lemma  is  offered  in  the 
appendix. 

The  Result 


for  all  6l'L1,x2, 


“  xi-l^ 


t  =  1,2 . k. 

The  minimum  mean-square  error  is: 

2  4^-1  2k-l  £  1  ~ 

6  v  -2ZIC  l  -k  P(x  )  (.3) 

0  r-1  4r  r 

The  proof  of  this  results  is  also  contained 
in  the.  appendix.  Nota  there  is  no  uniqueness 
claim  associated  with  the  optimum  mapping. 

Comments 

The'  significant  part  of  this  result  is  that 
the  optimum  rules  are  just  projection  mappings. 
This  may  be  seen  by  combining  equation  (6)  with 
the  last  part  of  the  lemma.  Hence  in  effect 
only  the  assignment  of  elements  of  S  to  the  code 
members  and  the  choice  of  G  as  a  subspace  are 
effected  by  the  MSE  criterion.  However  if  this 
is  the  desired  result,  the  sufficient  conditions 
of  the  theorem  are  easy  to  apply.  One  must  com¬ 
pute  a  finite  number  of  transforms,  order  them, 
and  extract  the  characters  according  to  in¬ 
equality  (7).  These  determine  the  rule  A  and 
it  is  possible  to  invert  it  and  thus  find  the 
encoding  rule  A^,-  .  We  can  also  determine  the 
code  G  and  compute  the  operating  mean-square 
error  if  we  wish. 

What  allows  us  f  bridge  die  sometimes 
large  gap  between  theory  and  true  implementation 
is  the  fact  that  V*  corresponds  to  suitably  de¬ 
fined  Walsh  functions.  Hence  the  abstract  trans¬ 
forms  are  the  well  known  Fine  transforms  [7] 
which  employ  Walsh  functions  in  their  kernels. 

The  exact  nature  of  the  transform  matters 
little  if  we  are  designing  a  fixed  system  be- 

^Ker  x,  is  the  kernel  of  the  homomorphism  x, • 

2  j  J 

The  symbol  (Xp  •••,  X^  denotes  the  subspace 
of  V*  spanned  by  these  characters. 
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cause  the  processing  cine  for  the  transforms  is 
not  critical.  However  one  possible  use  of  these 
codes  is  in  an  adaptive  system.  Since  the  Walsh 
transforms  of  the  channel  statistics  determine 
the  coding  rules,  the  equipment  required  for  the 
real-time  processing  in  an  adaptive  receiver  is 
not  only  feasible  but  practical.  If  ve  were 
using  a  one-way  channel  a  processor  at  the  re¬ 
ceiver  could  alcer  the  decoding  rule  X  sc  as  to 
sustain  optimum  or  near  optimum  XMCE  performance 
under  the  constraint  that  the  encoding  rule  re¬ 
main  fixed.  However  if  a  noiseless  feedback 
path  were  also  available  both  rules  and  the  code 
could  be  varied. 

The  Trans f erg.; 

We  note  the  following  property. 

Property  Tt'  character  group  V*  is  isomorphic 
with  the  1  ..  ,t  2n  Walsh  functions. 


i  »  0,1 .  2-1,  we  make  the  observation  that 

P  “P. (pq~^)  for  r“C,l .  n-1.  So  if  we 

i+2r  1  S 

have  P  constructed  i.i  the  firsc  2  position,  the 

next  7“  can  be  obtained  from  the  first  by  multi¬ 
plying  by  (pq-1)  and  linearly  translating.  Cou¬ 
pling  Chit-  with  the  symmetry  in  H,  the  vector 
H  P  can  be  obtained  by  summing  the  rows  of  a 
matrix  Q  which  is  defined  by  the.  following  ma¬ 
trix  product. 

fqn  pq”  il  n-1  f+1  +pq  j  1 
Q‘  n  n-1  ®  ®  +.  -1  |  (i3> 

{_q  -?q  L+)  -pq  J  j 

The  symbol  ®  denotes  the^Kronecker  matrix  pro¬ 
duct  whereas  the  symbol  ®  means  Xronecker  ma¬ 
trix  product  (p~1)  times.  Here  of  course  n>2. 
Therefore  the  vector  of  the  transform,  P  satis¬ 
fies: 

P  -  Q  1  (14) 


The  proof  is  obvious  once  a  suitable  de¬ 
finition  of  the  Walsh  function  on  V  is  given. 
Suppose  ucV  is  represented  as  u  » 

(uq,  u^,  ...,  un_^)  and  let  m,  an  integer  be¬ 
tween  0  and  2n-l  have  a  dyadic  expansion  as: 

m“m„2^+m, 2^+. . . ,+m  ,2n~^  where  m,  »  0,1.  A 

u  l  n~l  i 

definition  compatible  with  Fine's  [7]  is: 
n-1 

l  aiui  (9) 

wm(u)  -  t-1)1”0 

Thi3  transform  may  also  be  displayed  using 
matrix  and  vector  notation.  It  will  be  con- 


1^  is  the  column  vector  with  2n  ones.  It  easily 
follows  that 

P(wn)  -  (q-p)”  ‘  (15) 

z  is  the  number  of  zeros  in  the  dyadic  expansion 
of  the  index  m. 

Since  we  have  an  analytic  expression  for  the 
transforms  we  will  apply  the  theorem  to  the  gen¬ 
eral  case  of  an  (n,k)  binary  code.  The  linearly 
independent  Walsh  functions  as  determined  by 
part  (ill)  of  tha  theorem  are  those  With  indices 
which  are  powers  of  two.  Cbviously  the  choices 
are  not  unique.  The  MMSE  is  easily  computed  to 


venient  to  index  each  member  of  V  by  ltu  equiv¬ 
alent  radix  2  representation,  i.e.,  v^  where 

J“Vq  2^+v^  2*+...+vn 2n  1  corresponds  to  the 

n-tuple  (\',v, ,...,  v  ,).  We  will  define  the 
U  1  n-1  A 

two  column  vectors  I?  and  P  as: 

PT«(P(vn  |0)  ,P(v.  |0), . P(v  |0)>  (10a) 

2-1 

F-(P(wn),P(w  ) . P(v  ))  (10b) 

r  2-1 

We  form  the  matrix  H  by  defining  each  of  Its 
rowa  m  as  the  vector  representation  of  *n(v) • 
Hence  each  element  h  ,  of  H  is  w&(v,1  and  it  is 
easy  to  show  that  H  is  a  2nth  order  Hadamard 
matrix.  So  the  transforms  can  be  obtained  from 

r«HP  (ii) 

Examples 

We  will  present  two  examples.  In  the  first  ex¬ 
ample  we  will  consider  a  Binary  Symmetric 
Channel  (BSC)  with  bit  error  probability  p 
Let  q  “  1-p,  and  assume  that  q  »  p.  For  this 
case  P  is  of  the  following  form: 

_T  ,  n  n-2  n-1  2  n-2  n-1  2  n-2  2n-2 

p  -(q  ,pq  .pq  .p  q  >pq  .p  q  >p  q  . 


3  n— 3  n-1  n.  /is 

p  q  ........  ,p  q,p  )  (12 

If  ve  denote  the  elements  of  £  by  o-  where 


Our  second  example  concerns  a  compound 
channel,  i.e.,  a  channel  with  both  bit  and 
burst  errors.  At  this  time  there  ip  no  known 
analytic  expression  for  the  transforms  of  its 
transition  probabilities.  The  statistical  des¬ 
cription  for  this  example  is  described  as  fol¬ 
lows.  The  probability  of  no  errors  in  a  worn 
of  length  n  is  Cq  while  the  probability  of  a 
single  bit  being  in  error  is  e^.  We  assume  that 

.he  one  error  i r.  equally  likely  in  any  position. 

Gi 

Hence  P(0  |0)«e0  and  P(vlo)«  --where  v  has  only 
one  nonzero  component  in  its  n-tuple  representa¬ 
tion.  If  there  is  more  than  one  error  we  assume 
that  is  is  the  result  of  a  burst  error  contained 
wholely  within  the  received  word  and  that  each 
ourst  is  equally  likely  for  all  possible  config¬ 
urations.  Thus  the  distribution  of  the  b”.rst 
length  b  is  linear  and  may  be  descrioed  by  tne 
following  expression. 

2(l-£n-e.) 

P(b)=  - : — rc —  (n+l-b)  2<b<n  (17) 

n(n-l)  - 

Hence  the  channel  transition  probabi! J ties  for 
vectors  v  which  have  a  single  bursi  of  length  b 
in  them  are  given  by 

'lv!o)'  born  im 

2  (n-'Ori; 

For  this  channel  model  with  n-7,  c„-0.950  and 
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tj-0.025  we  have  computed  the  uecessar-  trans¬ 
forms.  For  a  (7,4)  cede  one  choice  of  the  op¬ 
timum  code  in  terns  of  the  theorem  is  given  by: 

“l"wr  x '■rv6'*’  x3“w32’  <ald  xi“v2‘  Thi  w*s»“ 
s^urre  error  is  0.9.16.  However  for  a  (7,3)  code 
we  ten  nuke  tr<e  frlloving  choices:  x,-w, -  y-.'w,  - 

JL  1  ■  Z  tjH 

and  X  In  C;i8  case  the  MSS  is  0.229. 
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Appendix 

This  app*-”dix  contain,".  the  detail  y  of  the 
proofs  of  the  results  contained  in  rhe  body  of 
this  paper 

Proof  o 2  Lerms. 

Suppose  that  u  and  v  are  In  V.  We  wish  to 
shew  that  >(u+v)  -  X(u)  @  X(v).  Towards  this 
end  we  will  need  a  basis  for  V.  But  since  V* 
is  isomorphic  with  V,  corresponding  to  the 

basis  {x.}k  of  V*  is  the  basis  (e, )n  of  V. 

*  i-1  1  i-1 

Furthermore  (e, }  may  be  taken  as  a  basis  for 
1  i-1 

G  while  te,}n  complete,,  the  basis  of  V. 

'■  i-k+i 

Specifically  we  associate  the  basis  with  the 
given  characters  by: 


, .  h i£  v1 

X,(v)-<  < 

;  +i  if  v -o 

i  1 


where  v-v,e,+. . . .+v  2  (Al) 
ii  n  n 


1*1,2, . . . ,  n 


n 

A  bl£i 


"  l  ciei 

i-1 


X  (u)  —  l  21 


h  n  b,a 
|  l-(-l)  1  n  (-1)  13 


X(v)-  >  2 

i*l 


L  *  I - 2 

i-1  t  . 

C*  U  4 

f  i-(-i)  .!  (-1)  J  iJ 

7  2K_i' _ i±>L- 

i*i  L 


]  (A3«> 

J 


\lso  we  have 


X(u+v) 


l  *■  1 

1-1  L 


r  b.+ci  n  b1aM+C<am 

i-(-D  1  1  n  (-1)  J  'J  J  iJ  I 
-J _ 1-H-i _ I, 


So  it  ramains  to  rhow  for  all  i-1,...,  k  that 


b,  S  b>a<, 

l-(-J)  1  +  l  >  iJ 


n  c  a 

7  J  ij 


l-(-l)  1  +  l 


b'+cl  E  (b,+c.)  a  . 
1-C-l)  *  1  +  l  j  j  ij  ) 


Let  m-n-k  and  assume  that  J  means  0.  We 

j-k+1 

will  demonstrate  the  above  by  induction  on  m. 
Suppose  m  -  0.  Then  by  mians  of  a  truth  table 
we  have: 

®[3^]  -  [i^-]  <*» 

Now  supposz  that  tA41  is  true  for  m-v-s-2.  The 
same  truth  table  shows  that  the  following  is 
elr.o  true. 

y,  b  a,  I  f  z.  c  a.  1 

Hi 1 0l  l-(-l)  *<-l)  n  lu 

-  f  *^a,  \b  +c  )"]  (A6) 

.  k±i).L 

L  2  J 

Therefore  (A4)  is  valid  for  m-n-ki 1 .  Take  any 
reS.  We  may  express  this  as: 


,0.  i1 

ruvl2  fr22  * 


It  is  easy  tc  show  that  if  we  specify  vcV  by 


v"vl*l  +...+  vfcek 


where  (-1)  *1-?^,  i-l,2....k.  (A8) 

then  X(\)  -  r  and  vcG.  Therefore  X  is  from  G 
onto  3,  Since  th :  sets  S  and  G  are  finite  and 

of  equal  siTe,  the  restriction  X_  is  au  isosor-* 

_ 


Thus 
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wn;  PTf>r  jTwjpysx  ;w 


Suppose  A  is  a  homoraorphi so  whose  restric¬ 
tion  is  an  isomorphism.  (2”,2  , . . . .  ,2!c~^}  is  a 
basis  tor  S  over  the  binary  field.  Hence  there 
is  basis  for  G,  {e. }k  ,  such  that  A,(a.)«2k  . 

1  i-1  G  1 
Define  a  set  of  characters  as: 


ijj'1,2,  ...»  k  (A 

is  the  Kronecker  Delta 


The  set  of  characters  in  V*/A*»  defined  as 
*  k  x 

(XjA  }  is  a  basis  for  V  /A  . 

1  i-1 

The  basi*’  i>r  <5  may  be  expanded  into  one 
for  V  by  add<f.„  he  vectors  {e,}n  .  Define 

-1  n-k+1 

another  set  of  characters  {x,)n  in  terms  of 

J _ 


Xj<em)-<-l)  J  j,m«k+l,  . . ,i>  (A1 

The  Xj's  are  linearly  independent  and  are 
constant  on  G;so  they  are  a  basis  for  A*.  If  a 

n 

generic  member  of  V  is  v  •  J  b.e.,,  then  since 

** 

X  is  a  homomorphism: 
n 

A(v)  -  l  b  A(fc.)  (All 

1-1  1 

•  l  b  2k_1©  l  b.  A(e  )  vAl2 
i-1  1  i-k+1  J  J 


From  a  truth  table  it  is  obvious  that 


fl-Xjlv)- 

'l  '  2 


i  -  1,2,...,  n 


Further  each  A(e^)  may  he  expressed : 
k  . 

A(e  >»  [  a  2  “  j-k+1 . . 

J  m-1  J 


Thus  combining  (A12)  and  (AiJ)  with  (A1A) ,  we 
find 


j.  -“IM 

1-uMl 


By  an  induction  argument  similar  to  the  one 
given  previously  it  is  easy  to  show  the  follow¬ 
ing  lndentity 


p  -  x‘  .1,  ‘iji 

L  2 - J 


space  of  squsre-3ummable  functions  defined  on  V. 

Suppose  A  is  also  a  projection  mapping  tak¬ 
ing  the  a  basis  elements  of  V,{v.,...,  \>  },  in¬ 
to  zec->-  Since  A  is  an  isomorphism  on  G,  we 
may  replace  u.  of  the  basis  elements  labeled 

<;k+1 . .  above  by  Vj^,  ....  v  through 

use  of  the  Exchange  Theorem  [6].  For  the  sake 
of  definiteness  we  may  assume  that  the  first 
m  e, 's  are  replaced.  Hence,  since  A(v,)-G,  we 
have  from  equation  (A14)  that  aJt.  .  -~0  for 

all  i  -  1,2 . k. 

Now  suppose  that  in  the  representation  of 
A  by  equation  (A)  that  there  are  re  indices, 

jj^ . jra  where  k+1  <  j,  <  n,2-l,2 . . 

such  that  a.  -0  for  all  i  »  1,2,...,  k. 

Select  the  corresponding  linearly  independent- 
characters  x,  a"d  basis  elements  e,  associated 

J  l  J  £ 

with  them  according  to  equation  (Al) .  It  im¬ 
mediately  follows  from  equation  (Al)  and  equa¬ 
tion  (A)  that  A(e.  )  -  0  for  sny  £  -  1,2,  ...,m. 
3i 


Proof  of  Theorem: 


The  mean  square  error  is  given  as 
£2  -  E{fAG(g)  -  >(v))2} 


-  i  l  (V2e)-^v))2p(8.v)  (A17) 

gcG  vcV  ° 

-4  l  l  (V(e)-iCv))2p(v-?io) 

2*  gcG  vcV 

By  expanding  and  collecting  terms  wr  must  con¬ 
sider  three  terns.  Since  Ap  is  an  isomorphism, 
the  first  of  these  terms  is: 


I  -’r(g)“  l  i2 


2U(2k-l) (2k+1-l) 


The  second  term  is  expressed  using  transforms. 

I  J  A“(v)  P(v-g (0) 
gcG  vrV 

“  ~5S  i  l  *  l  a  l  * 

2  gcG  acu*  geV  ytV 


A(a)A(f.)P(Y)  y(-g)  l  a(v)d(v)y(v)  (A19) 

vcV 

The  following  identities  ere  easy  to  show. 

I  2n  if  o8Y-X0 

l  o(v)S(v) y(v)-o  (*20) 

veV  0  otherwise 


(Xq  is  the  identity  in  V  ) 


The  uniqueness  for  a  given  G  follows  frjm  the 
linear  independence  of  the  members  of  V  in  the 


J  2k  if  X  e  A" 
I  x(g>4 

gCG  |  3  ifx<A* 

So  the  second  term  becomes: 


I  l  a  (v)P(v-g  |0)  - 
geG  veV 

,k  .  - 

—  I  X(a)X<6)  P(a6)  (A22) 

2Zn  (a8UA 

The  third  term  in  the  expansion  of  (A17)  is: 

l  l  X  (g)  X(v)  P(v-gjo) 
geG  veV 

*31  I  *  I  I  * 

2  aeV  Be  yeV 

X(a)X(B)P(y)  t  [  o(g)y(g)  £  Biv)y(v))  (A23) 
geG  veV 


wL*  "<"n“,p<s> 


Finally  we  have  an  t  /.pression  for  the  mean- 
square  error. 


+  (  I  *  X(o)X(6)P(a2)]  ( A24) 

lln  (aB)eA  XA247 

-4-  l  .  X(a)X(6)P(B) 

2"  (aB)eA 

The  summation  indexed  by  (06) cA*  may  be  express¬ 
ed  in  two  parts. 

I  *  “  I  *  I  *  +  l  I 

(aB)tA  aeA  BeA  a  and  6  (A25) 

ir.  same 
coset  of  A 

The  lemma  gives  an  expressipn  for  X.  It  is  easy 
to  show  that  the  transform  X  of  such  a  mapping 
has  the  following  properties 

(  l  X(v)«2n-1(2k-l)  if  a-xn 


I  2n+k  1 

x(.)^-<V>£ 


if  a-x  II  X, 

j-k+1  J 

otherwise  ( 


Combining  equations  (A25)  and  (A26)  allows  us  to 
evaluate  one  of  the  terms  in  equation  (A24) 

l  .  >(a)X(B)P(oB) 

(aB)cA 

»(2n~i  (2k-l))2+  (22k-l)  (A27) 


2 

l  .  X(u)X(B)P(B)-22n_2(2k-l)  P(Xft) 
(oB)eA'  U 

+22n+!k-2  |  J  }  J  *rj, 

r-1  4r  T  j-k+1  3 

So  the  mean-square  error  becomes: 


2  4k-l 


^  I  l*<xr  n  Xj  r2) 

0  r»l  4  r  j-k+1  3 


Suppose  that  X  is  an  optimum  mapping  o|  the 
-equired  type  and  that  G  is  the  subgroup,  A  is 
its  anr.ihilator ,  and  chat  the  independent  char¬ 
acters  (Xjy  '  and  the  constants  a^  are  its 

characterization  in  terms  of  the  lemma.  ^Speci- 
fically  let  {>,}n  be  the  basis  for  A  and 
*  V“k+1  *  * 

XjA  ,  .....  x^A  be  the  one  for  v  /A  .  Now  sup¬ 
pose  that  c  is  any  other  mapping  of  the  same 
tjpe  but  with  subgroup  and  its  annihilator 
B  .  Let  the  basis  for  B*  be  denoted  as  if,  , ,  , 

*  *  k+1 

...  f  while  the  basis  for  V  /B  be  denoted  as 
fjB*,  $>2b*>  •••»  f^B*.  Further  let  the  b^  's 

be  the  constants  in  the  formula  for  the  char¬ 
acterization  of  C. 

Because  of  the  optimality  assumptions  we 
find  a  necessary  condition  to  be: 


k  .  „  n  a  , 


k  .  .  n  b 

l  -7  P(fr  n  f  rJ)  (A31) 

r-1  4  1-k+l  J 

A  fact  that  we  will  use  shortly  is: 

n  a 

P(X,  n  Xj  3)  > 
j-k+1  3 

A  a  ai.ci  -i 

P(x, ,  1  n  X,  ,3>i*l,2 . k-1  (A32) 

j-k+1  3 

For  we  may  make  the  following  choice  for  the 
other  mapping  rule  5.  f  -  x,  for  all  j  “ 

1,2, .. .  ,n,  except  »3Xt  and  ^  *  X1+1* 

Also  take  all  a  ,  -  b  ,  except  b,,  «  a  ,  ,  tor 
rj  rj  ij 

all  j  and  b  .  ,  -  a. ,  for  all  j.  Then  since  X 

1+1.  *  J  lj 

is  optimal  we  must  have  by  inequality  (A31) : 


1  "  n  aii  1  n  aifl  i 

i  P(xt  n  Xj  ij)+  Kxi+i  n  xi 
41  1  j-k+1  3  41  x  1  Aj-k+l  1  ,. 


-4-  l  *  X(a)X(B)P(8) 

22n  (aB)cA* 


.  n  a . , ,  .  >  •  n  a , , 

-*^p(x1+i  n  xj  -rrip(xi  n  xj  j) 

4  j-k+1  3  41  j-k+1  3 


It  also  easily  follows  from  the  obvious  choices 
of  elements  In  inequality  (A31)  that 


Also  using  (A26) 
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n  °k1  * 

P<X„  n  x,  J)>  P(x„) »s-k+l,. . . ,  n 
Kj-k+l  J  8 

Another  consequence  of  optimality  is: 
P(it-.)>  P(8)  for  all  U 

. Vl’Xk+l»"-Xn]- 


P(xv  n  X,akJ)>p(B)  for  all  Be 
1-H-l  J 


*xk+l’"’’  xn^ 

Coupling  this  result  with  inequality  (A32)  we 
establish  the  following  strengthened  version  of 
inequality  (A35) . 


where  ^  -x.  n  J  with  l<i<k 

1  j-k+1  J 

To  demonstrate  this  we  first  note  that  there 
must  be  an  m,  with  i<m<k  such  that 

.7  is  a  linearly  in¬ 

dependent  set  by  virtue  of  the  Exchange  Theorem 
[6].  Next  we  construct  another  mapping  rule  t 
by  choosing  »  Xj  for  all  j  except  m  and  in 

n  a  , 

that  case  we  set  $^-8  n  Xj  •  Also  "we  £ake 
binary  constants  a^  for  all  r  and  j  in¬ 

dices  in  the  proper  sets.  Then  after  cancella¬ 
tion  we  have: 


~  P(x_  n  Xj  mJ)  >  ~  ?(8)  (A36) 

4m  ^  j-k+1  J  ‘  4m 

But  since  m  is  between  i  and  k,  an  application 
of  the  inequality  (A32)  completes  the  subproof 
of  inequality  (A35) . 

If  Be(xk+1 .  Xnl,  there  is  some  i, 

k+1  <  £  <  n  such  that  { xk+1 > • • • .  X^i 

®’x£+ !*'•*  X^)  ls  equivalent  to  the  original  set 

of  linearly  independent  characters. 

By  choosing  ,  and  b^j  -  0  for  j  “ 

k+1 .  n  but  all  i  /  k,  taking  ^  -  Xj  and 

a^j  -  b^  we  have  from  inequality  (A31) : 


P(^)  >_  P(8)  for  all  8^,...^]  (A38) 


where  iji  -x.  H  X. 

j-k+1  > 


with  i-1,2,...,  k. 


Since  the  {$. }  as  defined  above  are  also 
i  i-1 

linearly  Independent  characters,  we  may  relabel 
them  so  as  to  obtain  part  ill  of  the  theorem. 

An  application  of  the  lemma  gives  equation 

(6)  while  equation  (5)  follows  from  the  duality 
of  subgroups  and  quotient  groups  [6]. 

Suppose  that  the  rule  X  is  determined  by 
inequality  (7).  Further  suppose  that  £  is 
another  homomorphism  of  the  required  type  and 
that  its  characterization  by  the  lemma  is  in 
terms  of  linearly  independent  characters 

{p.  )n  ,  binary  constants  b  ,  u  .lihilator  B 
1  i»l  +J 

and  corresponding  subgroup  H.  From  equation 
(A30)  it  suffices  to  show  that 

!  ■— [P(x  J-PC*,.  n  *  brJ)]  >  0  (A39) 

r»3  4r  r  rj-k+l  - 

But  each  of  the  linearly  independent  characters 
Xf  for  r  -  1,2,...,  k  were  chosen  in  order  and 

in  a  maximal  fashion  according  to  inequality 

(7) .  Therefore  each  term  in  the  sum  of  the 
desired  inequality  (A39)  is  nonnegative  and 
thus  the  inequality  is  true.  Hence  we  have 
demonstrated  the  sufficiency  part  of  the  theorem 
as  well. 
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Abstract 

H.E.  Chrestenson  (4)  defines  a  class  of 
Generalized  Walsh  functions  using  the  concept 
of  Generalized  Rademacher  functions.  But  this 
is  ordered  neither  according  to  symmetry  nor 
according  to  sequency.  Here  a  generalized  con¬ 
cept  of  symmetry  is  introduced  and  an  ordering 
of  the  above  class  of  generalized  Walsh  func¬ 
tions  is  presented  in  terms  of  it.  A  measure 
of  oriented  phase  shift,  which  is  a  generalized 
concept  of  sequency,  is  introduced  and  an  or¬ 
dering  in  terms  of  this  is  given.  Two  differ¬ 
ence  equations  satisfied  by  this  class  of  gen¬ 
eralized  Walsh  functions,  one  ordering  accor¬ 
ding  to  symnctry  and  the  other  ordering  accor¬ 
ding  to  sequency  are  presented.  The  symmetry 
index  leads  naturally  to  the  tree  graph  as  well 
as  a  group  structure. 

Introduction 


which  was  defined  by  Chrestenson  as  products 
of  generalized  Rademacher  functions. 

In  the  generalized  Walsh  functions  the 
binary  element;  {0,1}  are  extended  to  fc-ary 
(i  an  integer)  elements  i  =  {0,l,2,....t  -  1), 
considered  as  the  phase  angles  in  units  of 

,  which  are  mapped  to  the  tth  roots  of  unity: 
i  .  e(j2,,/£)1'  =  y1. 

The  orthogonality  and  completeness  are  preserved 
in  the  extension  (4). 

Tensor  Product  and  Tensor  Sum 

The  generalized  Walsh  functions  of  order  1 
and  k  are  expressible  as  generalized  Hadamard 
matrices  as  follows. 


The  Walsh  functions  form  a  complete  set  of 
orthonormal  sequences  with  elements  {1,-1}. 
Higher  order  Walsh  functions  are  most  conveni¬ 
ently  generated  by  successive  tensor  products 
of  the  first  order  Walsh  functions-  This  pro¬ 
cess  is  further  simplified  by  mapping  the  ele¬ 
ments  {1,-1}  to  {0,1}  and  replacing  tensor  pro¬ 
ducts  bv  tensor  sums.  It  is  known  that  there 
are  2^  Walsh  functions  of  order  k  which  may  be 
ordered  according  to  sequency,  a  term  derived 
from  frequency  signifying  the  number  of  zero- 
crossings  in  the  waveform  representing  the 
functions  or  sequence  (8).  Also  it  is  known 
that  the  2 *  sequences  can  be  generated  and 
arranged  in  terms  of  odd  and  even  symmetry  (9). 
A  difference  equation  defining  the  Walsh  func¬ 
tions  in  an  ordering  according  to  sequency  is 
given  by  l.'armuth  (8). 

Generalized  Hadamard  Matrices 

A  Hadamard  matrix,  is  an  orthogonal  square 
matrix  whose  elements  ore  +1  and  -1.  Two  types 
of  generalizations  of  Hadamard  matrices  have 
been  studied,  (i)  Orthogonal  square  matrix 
HI(t,h)  of  order  h  with  l  >  t  distinct  integers 
as  elements  (7,10).  (ii)  Orthogonal  square 
mitrix  H(i,h)  of  order  h  all  of  whose  elements 
are  ith  roots  of  unity  (5).  A  subset  of  the 
latter  type  of  generalized  Hadamard  matrices 
forms  a  class  of  generalized  Walsh  functions 


,0)  J  Y°  y1  y2 

'  0  2  4 

v  v  v 


L  '  1  . .  J 

where  the  tensor  product  of  two  matrices  A  and 
B  is  given  by 


j  allB  a12B  .  .  .  a]nB 

I  a21B  a22B  *  •  •  a2nB 
*0  B  ’•  | . 

[  anlB  an2B  *  •  •  annBJ 

Both  of  these  matrices  and  H^  are  ortho¬ 
normal  over  the  field  of  complex  numbers.  These 
matrices  can  be  obtained  from  the  map  1  *  of 
each  element  of  the  matrices  hO)  and  hOO 
given  by 
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h*1* 


0  0  0  0  0 

0  12  3  4 

0  2  4  6  8 


0 

2-1 
2-  2 


0  2-1  5.-2 


1 


h(k)=  h(1)C+]  h(1)[+]  h(1)[+]  ...[+]  h(1> 


where  the  tensor  sum  of  two  matrices  A  and  B  is 
given  by 


A[+]B 


n+B 

a-|2+B  •  •  • 

aln+!f 

21+B 

a22+B  .  .  . 

a2n+B 

nl+B 

an2+B  .  •  . 

ann+B 

where  the  sum  a  +  B  indicates  the  matrix  ob¬ 
tained  by  adding  a  to  every  element  of  B,  the 
addition  being  taken  modulo  2.  It  is  to  be 
noted  that  h(*)  is  no  longer  orthonormal.  It 
represents  a  vector  space  of  dimension  k  over 
the  ring  of  integers  modulo  2  (according  to  the 
definition  of  vector  space  given  in  Van  Der 
Waerdern)  (11). 


Symmetry  Index  for  Generalized  Walsh  Functions 

The  2  rows  of  the  matrix  h^  define  2  dif¬ 
ferent  symmetries  among  the  components  of  the 
row  vectors,  called  "2-ary  symmetries".  Equiva¬ 
lently  in  the  mapped  case  the  corresponding  rows 
of  HO)  define  2  different  "2-ary  symmetries". 
For  example  the  ternary  symmetries  are  given  by 
the  rows  of  hO)  when  2  =  3  namely,  (0  0  0), 

(0  1  2)  and  (0  2  1 )  or  equivalently  for  HU) 
( y°  y°  Y?)  or  equivalently  (y°  y2)  and 

(v°  yz  Y  )  which  can  be  represented  as  in  Fig.i. 


(a) 


If  we  denote  8}  =  (0  1  2  ...  Z  -  1),  the  2-ary 
symmetry  of  index  a  is  given  by 

a  U-j  =  (0  a  a  +  1  ...  -a)  where 
a  =  0,1,  ....  2-1. 

A  set  of  k  basis  vectors  for  h^  can  be  obtain 
ed  in  terms  of  the  2-component,  vectors 
Un  =  (000  ..  0)  and  Us  =  (012  ..  2  -  1)  as 

..0 
..0 


fBllows 

U 


U, 


100 

010 


-  «,[+]  u0OJ  u0O]  ...  [+]U0 

=  u0[+]  u,[+]  u0[+]  ...  [+lu0 


U000  ..1  =  uo[+]  uow  uot+] 


[+]U, 


(kl 

The  general  row  of  h'  '  considered  as  a  vector 
with  indexes,  a  (a0ai  ...  oq<-i),  referred  as  sub¬ 
script,  is  obtained  by  linear  combination  of  the 
basis  vectors.  Each  basis  vector  is  multiplied 
by  tne  corresponding  component  of  the  index  and 
the  addition  is  digit  by  digit  modulo  2.  Con-,. , 
si der  an  element  U.  „  belonging  to  h'. 

“o“l  °k-l 

This  vector  has  2k  digits.  The  synmetry  index 

...  ak  l  Implies  that  the  digits  are  re¬ 
lated  by  synmetry  ak  ,  (or  its  cyclic  permu¬ 
tation)  inside  each  iubblock  of  2  digits,  and 
the  subblocks  of  2  digits  are  related  by  sym¬ 
metry  a.  ?  (or  its  cyclic  permuation)  inside 
each  blocK  of  digits  and  so  on.  Lastly,  all 
the  2"  digits  are  related  in  blocks  of  2k_'  by 
symmetry  a  .  Thus  given  the  synmetry  index,  a 
vector  C3n °be  written  withput  referring  to  any 
other  member  of  the  set  h(K).  Also  the  2-ary 
symmetry  of  the  Walsh  functions  shows  that  they 
can  be  generated  as  a  tree  code.  This  is  illus¬ 
trated  by  examples  1  and  2. 

Example  1 

Consider  2=3,  k  =  2. 


h™- 


'0 

0 

0 


0  0" 
1  2 
2  1 


Fig.  i.  Ternary  symmetries  (a)  with  index  0; 

(b)  with  index  1;  (c)  with  index  2. 

0+h^ 

0+h(1) 

0+h{1,| 

h®  ■  „(')w  „(o. 

0+h^ 

WD 

2+h(1)| 

This  concept  of  ternary  synmetry  was  used  in 

\ 

0+h^ 

2+h(1) 

l+h(1)j 

representing  3-phase  unbalanced  power  systems  by 
symmetrical  components.  Any  cyclic  permutation 
of  a  symmetry  is  considered  as  belonging  to  the 
same  symmetry  with  a  certain  initial  phase. 

Thus  (0  12)  and  (12  0)  are  the  same  symmetry 
with  initial  phase  0  and  1  respectively. 


000000000 
0  1  2  0  1  2  0  1  2 
021021021 
000111222 
=  012120201 
0  2  1  1  0  2  2  1  0  j 

0  0  0  2  2  2  1  1  1  [ 

0  1  2  2  0  1  1  2  0  | 

.  0  2  1  2  1  0  1  0  2  j 

The  basis  vectors  for  h^  are 

uro  "  Ui  l+]  UQ  =  (0  0  0  1  1  1  2  2  2) 

UQ  i  =  u0  W  ui  =  (°  1  2  0  1  2  0  1  2) 

A  vector  of  symmetry  index,  say,  21  is  obtained 

U21  =  2U1q  +  UQ1  =  (0  1  2  2  0  1  1  2  0) 

where  the  addition  is  digit  by  digit  modulo  3. 
Clearly  the  symmetry  inside  every  subblock  of  3 
digits  is  of  type  1  and  the  symmetry  between  the 
3  subblocks  is  of  type  2.  Representing  as  a 
tree  code,  Fig.  i i ,  we  note  that  the  first 
branching  is  determined  by  the  symmetry  index 
a  and  the  next  branching  is  specified  by  the 

1 _ Oj 

symmetry  index  a  a.  ,  and  so  on. 

_ Li 


Index  Vector  Code  Vector 

.a0  Jl.  2<L 


0  0  00000 0 


1  0  0 

0  oj 

1112  2  2 

2  0 

1  2  2  2  1  1  1 

0  1 

012012 

1110 

1  2 

’l  2  0  2  0  1 

2  1 

2  0  112  0 

0  2 

0  2  1  0  2  1 

1  2  2 

2  1 

1  0  2  2  1  0 

2  2 

2  10  10  2 

Fig.  ii.  Tree  code  representation  of  the 
32  pre-mapped  Walsh  functions. 


Example  2.  Consider  Z  =  4,  k  =  2,  then 


h 


O)  = 


0  0  0  O' 
0  12  3 
0  2  0  2 
0  3  2  1 


t)\ 

A  set  of  basis  vectors  of  h1  '  for  symmetry  in¬ 
dexing  is  given  by 

U1Q  =  d1  [+]  UQ  =  00Q01 111 22223333 

UQ1  =  UQ  [+]  U1  =  0123012301230123 

A  vector  of  symmetry  index,  say,  32  is  obtained 
thus 


U32  =  3U10  +  2Uq1  =  0202313120201313. 

Clearly  the  syrmetry  inside  every  subblock  of  4 
digits  is  of  type  2  and  the  symmetry  between  the 
4  subblocks  is  of  type  3.  Tree  code  represen¬ 
tation  of  hU)  is  given  in  Fig.  iii. 

Index _ Code  Vectors _ 


0  0 

000000000000 

1  0 

111122223333 

2  0  0 

0  0  0 

222200002222 

3  0 

333322221111 

0  1 

012301230123 

1  1 

123023013012 

2  1  1 

1  2  3 

230101232301 

3  1 

;  301223011230 

0  2  — 

020202020202 

1  2  2 

131320203131 

2  2 

2  0  2 

202002022020 

3  2 

313120201373 

0  3 

032103210321 

1  3 

103221033210 

2  3  3 

3  2  1 

210303212103 

3  3 

321021031032 

Fig.  iii.  Tree  code  formed  by  the  42  pre¬ 
mapped  Walsh  functions. 

Phase  Index  and  Generalized  Sequency 

Selecting  the  basis  vectors  properly,  as 
given  below,  the  2*  vectors  can  be  ordered  in 
terms  of  phase  number  or  sequency  number  2 
ranging  from  0  to  -  1  in  the  increment  of  1, 
It  can  be  shown  that  this  number  6  is  equal  to 
the  amount  of  oriented  angular  phase  shifts  in 
the  units  of  2n(£  -  1 )/Z  of  the  vector 
%  ■  V  306i  ..  Bk_i  where  &  =  B02]  ...  Bk.-, 

is  called  the  phase  or  sequency  index  and 
k-!  . 

6  =  l  g.t  the  phase  or  sequency  number. 
i=o  1 
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errors 


iiiii^i^ij.ii^uj, ,~X-  3gg!a^a%gS£%P9gy^^ 


/  v\ 

A  set  of  basis  vectors  of  hw  for  the 


phase  indexing  is  obtained  from  the  . 

£  component 

vectors  V„  = 

(0  0  0  ...  0)  and 

V,  =  (0  1  2  . 

, ..  1  -  1)  as  follows: 

V1000  ..  0  = 

v,[+]  v0O]  v0[+3 

....  Wv0 

V0100  ..  0  = 

U-i  )v,  [+]  v,[+]  v0[+] 

....  [+]V0 

V0010  ..  0  = 

v0C+]  (t-Dv,[+]  v,[+] 

....  [+]V0 

V0000  ..  1  = 

V0[+]  V0t+]  v0w  ..  [+){*-!  JV^+IV, 

A  general  row  of  h^)  considered  as  a  vector 
with  index  ,8,  =  606-j  ...  6k_-)  is  obtained  by  the 

linear  combination  of  the  above  basis  vectors, 
thus 

VBo6l  ...  Bk-1  =  6oVin00  ..  0 


+  61V0100  ..  0  +  •••  +  6k-lV0000..1 


where 


B^  =  f 0 » 1  ,a,  ....,  £  -  1), 

i  =  10,1,  ....  k  -  1)  . 


Example  3  Let  t  =  3,  k  =  3,  then  the  basis  vectors  for  phase  indexing  is  given  by, 

V100  =  V1  V0  ^  V0 

=000000000111111111222222222 

0)  0) 

V010  =  2V1  ^  V1  ^  vo 

=000111222222000111111222000 

i 

I 

0  1  2  2  0  1  1  2  0 

(DO)  0)0)  0)0) 

2  0  1  2  0  1  2  0  1 

0)0)0)0)0)0)0)0)(2)0)0)0)(1)0)0)0)0)(2)0)0)0)0)0)0)0)(1) 


0)  0) 


0)  0) 


0)  0) 


VG0,  =  vc  [+]  2V,  03  V, 

=  012201120012201120 
0)0)  0)0)  0)0)  0)0)  0)0)  (1)0) 
(3) 

Any  vector  of  hw/  with  index,  say,  211  can  be  ootained  thus 


V211  =  2V100  +  1V010  +  1V001 
=  012  012012120120120 


The  numbers  inside  the  parentheses  are  the  phase 
shifts  in  the  units  of  2n/3  occurred  between 
certain  successive  digits.  The  total  shifts 
occurred  in  Vgn  is  28{2n/3 )  which  upon  division 
by  2(£  -  ^)/^  =  2tt(2/3)  is  14.  The  sequency 
number  corresponding  to  the  index  211  is 
2.3°  +  1.3l  +  1.32  =  2  +  3  +  9  =  14,  as  expected. 

It  is  to  be  noted  that  the  phase  increments 
for  the  three  basis  vectors  are  properly  distri¬ 
buted.  By  properly  we  mean  that  (a)  their 
locations  are  nonoverlapping,  (b)  they  are  uni¬ 
formly  distributed  t'o  fill  ail  positions,  (c) 
the  number  of  units  of  phase  shifts  are  coimien- 
surate  with  the  index  positions  of  the  three 
vectors  <.e.,  V,Q0,  VQ,0,  VQQ1  have  respectively 

2.3°,  2.31,  2.3*  urits  of  phase  shifts.  This 
of  course  is  the  reason  for  the  above  choice  of 
the  basis  vectors. 

We  observe  that  the  symmetry  index  and  the 
phase  index  are  in  one-to-one  correspondence  and 


tnai  one  can  be  obtained  ^rem  the  other  very 
easily.  Let  the  symmetry  index  and  the  phase 
index  of  an  element  of  the  set  of  Jr  vectors 
be  Qj  =  a  a,  . . .  on,  and  ,8,  =  B  B,  . . .  Bk_, 
respectively.  Then  they  are  related  by 

k-1 


6i 


=  X.  a3  » 

3=1  ° 


(*) 

“j 

where 


i  =0,1,2,  . . • ,  k 
or 


=  6j  -  6j+l 


and  ok_,  =  8k., 


3  =  0,1,  ...,k  -  2. 


Thus  when  the  sequency  number  of  a  waveform 
belonging  to  the  set  of  Jtk  vectors  is  given, 
the  corresponding  sequency  index  and  sym¬ 
metry  index  can  be  obtained  and  the  vector  can 
be  written  from  left  to  right  using  synmetry 
index,  without  referring  to  any  other  member  of 
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the  set.  The  symmetry  index  of  the  tensor  sum 
of  two  vectors  with  synmetry  indices  is  the 
direct  sum  of  the  separate  indices.  This  alonq 
with  the  relations  {*)  is  useful  in  obtaining 
sequency  indices  and  sequency  numbers  of  higher 
order  vectors  from  lower  order  ones  in  an  itera¬ 
tive  form. 

Symmetry  Index  and  Period 

Let  U  ,  an  element  of  h^  with  synmetry 
index  ^  &  =  cigc^  ...  ak_pbe  represented 


Pi  =  °*  if  Pi+l  *  °*  1  =  O’1*--"  k  -  ’’ 


ua  =  (ao’al’ 


3  k  1 

r  -  i 


a^  =  {0,1,  . £  -  1} . 

(k'  k 

Then  the  period  p'  of  the  corresponding  £ 

component  discrete  Walsh  function  is  the  smallest 

number  for  which  a  ,  =  a„  where  the  addition 
„.„(k)  m 

i,  m+p  , 

is  modulo  (£  ).  Let  upjJw  =  pQp1  ...  pk  he  the 


k  111  f  (L\ 

is  modulo  (£  ).  Let  upjJw  =  pQp1 
£- ary  expression  of  pW  where 

P(k)  =  l  p1  t1. 


that  is,  corresponding  to  a.  =■  a  a,  ...  a.,  , 

(k'i  0  K" 

we  have  .  px  =  pQp1  ...  Pj,.  The  following  re¬ 
sult  shows  that  the  period  p^can  be  obtained 
from  the  symmetry  index.  The  converse  is  not 
true  as  there  is  no  one-to-one  correspondence 
between  period  and  symmetry  index. 

(i)  £  is  a  prime  number 


if  <*j  =  0 


pk-i  =  \ 


[1  if  a,-  i*  0 

Pi  =  0,  if  pi+-j  f  0,  i  =  0,1, . k-1, 

P0  =  1  if  Pi  =  P2  =  •••  =  pk  =  °- 


po  =  1  1f  Pi  "  P2  = 


Pk  =  °» 


where  (x,y)  is  the  greatest  common  divisor  of  x 
and  y.  See  example  4.  for  the  binary  case,  a 
similar  result  has  been  reported  (12). 

Difference  Equations 

Generalized  Walsh  functions  can  be  defined 
by  either  of  the  following  difference  equations. 

(a)  A  difference  equation  which  orders 
the  Walsh  functions  in  terms  of  a  number  called 
symmetry  number  which  we  denote  by  a.  As  is  . 
given  in  example  4,  representing  the  set  of  £ 
Walsh  functions  of  order  k  as  ^-component  vec¬ 
tors,  the  vector  W(u,8)  has  symmetry  number  ct 
and  symmetry  index  ct0c^  ...  where 

k-1 

a  =  l  ct-jt1  . 
i=o 

We  write  the  difference  equation  for  the 
generalized  Walsh  functions  in  the  following 
form: 

W(£n+q,  6)  =  W(n.  £0)  +  Y°W(n,  £0-1) 

+....+  Y^-^qW(n,  £0  -  £-T) 


n  =  0,1,2 . r  '  -  1; 

3  =  0,1 ,2,  •  •  •  • »  £  ~  1 5 

Y  =  e2jll/*  ;  W(o,e)  =  Y°,  0  <  0  <  1; 
and  the  exponent  of  Y  is  taken  modulo  £. 
See  Example  4  on  next  page. 


(ii)  £  is  not  a  prime  number 
T  '*.-,*)  =  1 


n  it  uj/l,  n  =  — 


pk-i-l  = 


m  if  a-il,  m 


(a^,£) 


and 


t 


-"V  ^^.j^-w*!fJ«?®«rw«W'3«S!9* 


Example  4.  Let  £  ^  3  and  k  =  2 


n  q  a0«5  W(a,0)  W(a,6)  as  3  -component  vector 


Period 


0  0  0  0 
0  110 


u/n  0\  ooooooooo 

w(o.e)  yyyyyyyyy 


W(1 ,0)  Y°  Y°  Y°  Y1  Y1  Y1  Y2  Y2  Y2 


2  2  0 


W(2,6)  y°  Y°  Y3  Y2  Y2  Y2  Y1  Y1  Y1 


1  0 
1  1 
1  2 
2  0 


0  1 
1  1 
2  1 
0  2 


W(3,0)  y°  Y1  Y2  Y°  Y1  Y2  Y°  Y1  Y2 


W(4,6)  y°  Y1  Y2  Y1  Y2  Y°  Y2  Y°  Y1 


W  ( 5 , 9 )  Y°  Y1  Y2  Y2  Y°  Y1  Y1  Y2  Y° 


W(6,e)  y°  Y2  Y1  1°  Y2  Y1  Y°  Y2  Y1 


2  112 
2  2  2  2 


W(7,0)  Y°  Y2  Y1  Y1  Y°  Y2  Y2  Y1  Y° 


W(8,0)  y°  Y2  Y1  Y2  Y1  Y°  Y1  r°  Y2 


PpPl  P2 
1  0  0 
0  0  1 
0  0  1 
0  1  0 
0  0  1 
0  0  1 
0  1  0 
0  0  1 
0  0  1 


(b)  Walsh  functions  ordered  according  to  sequency  number  0  may  be  defined  in  a  similar  manner 
as  in  (a)  by  the  following  difference  .quation 


W(£n  +  q,0)  =  W(n,£0)  Yq+fflW(n,t0  -  1)  +....+  yU'1 ) ^^wfn.te-  i  -  1) 


where  m  =  (i.  -  1)  i  [x]  denotes  the  greatest  integer  less  than  or  equal  to  x,  W(O,0)  =  y° 


0  <  6  <  1;  and  the  exponent  of  is  taken  modulo  l. 


Example  5  let  2  =  3  and  k  =  2. 


n  q  m  W(B,8)  H(6,0)  as  3  -component  vector 


0  0  0 
0  1  0 
0  2  0 
1  0  2 
1  1  2 
1  2  2 
2  0  4 
2  1  4 
2  2  4 


W(O,0) 

W(i,e) 

w(2,0) 

W(3,0) 

W(4,0) 

W{5,0) 

W(6,0) 

W(7,0) 

W(8,0) 


0  0  0  0 
Y  Y  Y  Y 


0  0 
Y  Y 


0  0  0  1 
Y  Y  Y  Y 


.1  .1 


Y2  Y2 


0  0  0  2 
Y  Y  Y  Y 


Y1  Y1 


f1  Y2  Y2 


Y°  Y1  Y2  Y° 


Y1  Y2 


Y°  Y1 


0  12  1 
Y  Y  Y  Y 


..2  ..0 


2  0 
Y  Y 


Y°  Y2  Y1  y' 


..0  ..2 


Y2  Y1 


0  2  12 
Y  Y  Y  Y 


Y1  Y° 


0  2  10 
Y  Y  Y  Y 


0  2 
Y  Y 


\ 


\ 


\ 
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Discussions 


The  ordering  of  the  class  of  generalised 
Walsh  functions  in  terms  of  their  iymmetry  in¬ 
dex  g,  or  phase  i nc.ux  i s  pertinent  in  the 
following  applications. 

(a)  In  the  generation  and  detection  of 
Walsh  waveforms,  the  implementation  is  simpli¬ 
fied  by  the  structure  of  indexing. 

(b)  The  selection  of  appropriate  Welsh 
functions  for  the  analysis  and  synthesis  of 
signal  waveforms  may  be  facilitated  if  the  wave¬ 
form  can  be  attributed  to  a  set  of  salient  com¬ 
ponents  with  specified  symmetries  or  phase 
shifts. 

(c)  Combination  and  decombination  of 
Walsh  functions  of  various  orders  are  much 
facilitated  by  means  of  the  indices. 

b 

(d)  The  entire  set  of  i  Walsh  functions 
form  a  group  under  digit  by  digit  multiplication 
modulo  y.  This  group  is  represented  by  the 
group  of  symmetry  indices  under  digit  by  digit 
addition  modulo  l.  In  addition  to  the  examples 
cited  before,  let's  consider  the  case  that  l  is 
a  composite  number,  (examples  6  and  7}  then  the 
numbers  modulo  l  can  be  listed  as  subgroups  to¬ 
gether  with  their  cosets.  This  is  also  true 
for  the  number  £*.  The  listing  of  Walsh  func¬ 
tions  in  subgroups  and  cosets  leads  to  further 
simplifications  and  insights. 

Example  6  Let  S,  =  6,  k  =  1 

Subgroup  024 
Coset  1  3  6 


In  other  words,  since  l  =  3  x  2,  a  compo¬ 
site  number,  the  entire  set  of  6  Walsh  functions 
may  be  listed  as  a  subgroup  ot  3  functions 
(possessing  3  different  syrrmetri es )  plus  a  coset. 
It  is  also  possible  to  list  them  as  a  subgroup 
of  order  2  and  2  cosets. 

Subgroup  0  3 

Coset  1  4 

Coset  2  5 

Example  7  Let  l  -  6,  k  -  2. 

Subgroup  00  02  04  20  22  24  40  42  44 

Coset  01  03  05  21  23  25  41  4?  45 

"  10  12  14  30  32  34  50  52  54 

"  .  11  13  15  3i  33  35  51  53  55 

Here  =  6^  =  3^  •  2^,  the  entire  set  is  listed 
as  a  subgroup  of  order  3^  pluse  (22  -  1)  =  3 


ccsets.  The  group  operation  is  digit  by  digit 
addition  modulo  6.  Note  that  the  listing  of 
example  7  is  a  representation  by  symmetry  in¬ 
dices  of  the  following  tensor  sums 

U0  U2  U4  U0  U2  U4 

[+] 

U1  U3  U5  LU1  U3  U5 

While  this  paper  emphasizes  primarily  in 
introducing  two  indices  &  and  A  it  also  serves 
the  purpose  of  obtaining  perioa  pin  terms  of^a, 
and  of  relating  three  recurrence  methods 

(i)  difference  equation  (ii)  tensor  product 
and  (iii)  tensor  sum,  the  last  being  easily 
handled  especially  in  terms  of  the  indices. 
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Introduction 


for  H^Cs)  is  (for  n>0) 


The  properties  and  applications  of 
orthogonal  functions  like  Bessel  func¬ 
tions  trignometric functions,  spherical 
functions,  orthogonal1  polynomials,- 
Haar  functions  and  Walsh  functions  ^in 
various  engineering  applications  is  well 
known.  Besides  the  popular  trigonomet¬ 
ric  functions,  more  general  classes  of 
complete  systems  of  orthogonal  functions 
have  been  used  for  theoretical  investi¬ 
gations  as  well  as  equipment  design,  in 
recent  years.  Particular  areas  in  which 
complete  sets  of  orthogonal  functions 
have  been  applied  are  as  ..diverse  as 
coding  and  multiplexing,'3*'"  signal4  24 
processing5and  'aneral^application^ , ’ 
vocoding,  filtering,  radiatior, 
pattern  recognition  ana  image  process¬ 
ing,  and  spectroscopy.  Different  sets 
of  orthogonal  functions  have  some  under¬ 
lying  common  properties.  For  example, 
most  of  the  generally  used  systems  of 
orthogonal  functions  are  defined  by 
linear  differential  or  difference  equa¬ 
tions  of  second  degree. 

II 

In  1967,  Reza  and  Bose,  made  use 
of  an  interesting  mathematical  property¬ 
interlacing  of  zeros  of  successive- 
polynomials  in  a  set  of  orthogonal 
polynomials  like  Hsrmite's,  Legendre's, 
Laguerre's,  etc.-  to  generate  two  ele¬ 
ment  kind  gqsitive  real  functions.  A. 

M.  Soliman1"  extended  the  foregoing 
idea  lo  some  other  orthogonal  functions. 
In  view  of  the  overriding  influence  of 
orthogonal  functions  in  various  branches 
of  science,  it  is  deemed  fit  to  make 
available  the  results  to  date  on  this 
aspect  of  the  subject  to  the  interested 
readers . 


Hn+2(s)  -  2s  Hn+1(s)  +f2n+2)Hn(3)=0, 
with  Hq(s)  =  1,  and  H^(s)  =  2s. 
Evidently,  _  1  is  a  LC  driving 


H"T5s7 


7F 


point  function.  From  the  recurrence 
formula , 


^na]isl 


jH  ( js) 

=  2s  +  _JL__  (2n+2) 
Hn+l^s> 


Thus,  if  3Hn(js)  ij.  lc  realizable,  so 
also  are  Hn+2^s^  and  its  reciprocal^4 


iHn+i(3S> 

3^3-iT- 


Though  the  principle  of  mathe- 
mat  cal  induction  can  be  used  with 
facility,  an  alternate  approach  will  be 
adopted  to  prove  Theorem  2 , 


Theorem  2.  The  r.*al  rational  function, 

j  Pn<j‘> 

Z^-Cs)  =  P — -Tjs^  *  driving-point 

reactance  function,  where  P  <s)  is  the 
Legendre  polynomial  of  r.  order. 

Proof:  The  legendre  polvnomials,  P_(s), 

15  n 

n  =  0,1,2,..  as  defined  by  Rodrigues' 
formula,  are 


,  .Hz  2  ,  n 

P  (S)  =  i - L_ 

n  2nn!  dsn 


Proofs  For  Some  Generated  P.  R.  F.'s 

The  proofs  for  the  generated  posi¬ 
tive  real  functions  can  be  given  by  us¬ 
ing  the  principle  of  mathematical  induc¬ 
tion  or  otherwise.  Theorem  1  is  proved 
using  the  induction  principle. 

Theorem  1.  The  real  rational  function, 

jj - TJ¥)  ’  w*iere  pn(s)  ls  Hern’ite 

polynomial  of  nth  order,  is  a  LC  driving 
point  function. 

13 

Proof:  The  recurrence  relation  valid 


It  is  readily  seen  that  P  (s)  has  n  real 
roots,  all  lying  between  ns  =  +  1.  Con¬ 
sequently,  P^C js)  =  0  has  n  imaginary 
roots,  all  lying  between  s  =  +_  j .  For 
odd  values  of  n, 


-j  pn(3s> 


1  dn[(s2+l)nl 
2nn !  dsn 


n+1 


( js)  = 


2n+1(n+l)! 


dn+1[(s2*i>n+1] 


1  dr‘Cs(s2+l)n] 
n 


2nn: 


os 
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k*  -  "sk **v  i 


whence  -  fPn+1(js>3  +  C-j  ?n(js)3 


1  dnC<5+i)(s--t-l)n]  clearly,  -Pn+l(Js) 


and  -j  P  (js),  are,  for  odd  n,  the  even 
and  odd  nparts  of  a  real  Hurwitz  poly¬ 
nomial.  An  analogous  procedure  is 
adopted  for  even  n  to  arrive  at  a  simi¬ 
lar  result.  This  implies  that 

i  P  (no)  , 

J  n  1  is  a  reactance  function. 


Orthogonal  Functions  and  Network  Types 

The  table  gives  the  generated  posi¬ 
tive  real  functions  (p.r.f's)  from 
corresponding  orthogonal  functions,  and 
includes  for  completion,  those  reported 
earlier  by  Reza  ar.d  Bose.  It  is  seen 
that  a  wide  variety  of  networks  are 
characterized  by  the  generated  p.r.f's. 


in  the  table, the  first  eleven 
driving-point  functions  chai'acterize 
lumped  networks ,  and  the  remaining 
characterize,  in  general,  lumped- 
distributed  networks.  In  particular, 
the  first  seven  sets  of  generated 
functions  characterize  LC  networks,  the 
eighth  characterizes  a  RLC  network,  and 
the  ninth,  terth  and  eleventh  correspond 
to  the  driving  point  impedances  of  RC 
networks.  It  is  interesting  to  note 
that,  though,  the  Tschebyscheff  poly¬ 
nomials,  Gegenbauer  polynomials,  and  the 
Legendre  polynomials,  which  are  all 
special  cases  of  the  hypergeometric 
oolynomials  of  Jacobi,  can  be  used  to 
generate  p.r.f's  in  the  manner  just 
indicated,  the  Jacobi  polynomials,  in 
general,  cannot  be  so  used.  This  fol¬ 
lows  from  the  fact  that  the  location  of 
the  roots  of  the  Jacobi  polynomials  are 
r.ot  symmetric  with  respect  tc  the  ori¬ 
gin.  Interestingly  enough,  the  twelfth 
generated  function  is  a  positive  real 
function  of  several  variables,  which  are 
being  used  more  and  more  in  the  sy^Jh|j 
sis  of  lumped-distributed  networks.  ’ 

The  last  three  generated  functions, 
obviously  characterize  distributed  net¬ 
works.  The  results  concerning  the  Walch 
functions  can  be  obtained  using  the 
difference  equations  defining  them. 


It  must  be  borne  in  mind,  that 
other  p.r.f's  can  be  generated  from  the 
given  orthogonal  functions,  with  equal 
facilj|y.  The  procedures  for  genera¬ 
tion,  among  those  available  in  the 
literature,  will  depend  upon  the  desired 
types  of  applications  to  wnich  the  gen¬ 
erated  functions  are  to  be  put.  It 
appears  that  many  useful  properties  of 
orthogonal  functions  can  be  quickly 
proved  by  constructing  suitable  network 
models  using  the  generated  functions,  as 
suggested  by  Reza  and  Bose,  earlier,  and 
also  more  retje^Jly  discussed  by  a  couple 
of  authors.  ’ 


Table 


Name  of  Ortho¬ 
gonal  Function 


Generated 
P.R.F.  's 


1.  Legendre  poly¬ 


nomials,  Pn(s). 


i  Vis) 


2.  Associated 


<.  ■  nooworu  too  .  — m  .  .  » 

Legendre  spherical  3 

harmonic  of  the  pm  ,  .  * 

first  kind,  n+l'** 


P™(s>. 


3.  Gegenbauer  or 
modified  ultra- 
spherical  poly¬ 
nomials. 


'j  Cn+l(3s) 


4.  Tschebyscheff 
polynomial  of  the 
first  kind, 

T^1)<s). 


j  V'tjs' 


T?+-^s) 


5.  Tschebyscheff 
polynomial  of  the 
second  kind, 

t!2)(s>. 


i  T^2)(js) 


V’Cjs) 


6.  Hermite  poly¬ 
nomial  Hn(s) . 


j  Vjs) 


7.  Parabolic 
Cylinder  function, 
D  (s) . 


j  Vis> 


8.  Bessel  poly¬ 


nomial,  P.  (s). 
n 


s  3  ,  ( s ) 

n-1 


9.  Laguerre  poly¬ 


nomial,  L  (s). 
n 


L  ( -s ) 
n 


10.  Uspensky 


polynomial,  Un(s). 


Vs> 

Un+1'^" 


11.  Second-ordgr 
Q -polynomial, 


12.  n-variate 
Hermite1 
polynomial , 

u(n)  , . 


3H£-!n(-’xl>  —  3xn) 


*1— n+1 


(-jx,  ,-jxn+1> 


‘1234<xl,x2’x3,-"xn) 


13.  Bessel's  func¬ 


tion  J  Cs) . 
n 


i  JnViS> 


14.  Fourier  trans¬ 
forms  9^  Walsh 


Jn(3s) 


pulses* 

jS(n,f),  C(n,f) 


kS(n+l,  jf)' 


Conclusions 


It  has  been  shown,  that  using  the 
principle  of  mathematical  induction  or 
otherwise,  it  Is  possible  to  genex»ate 
positive  real  functions  from  successive 
functions  in  sets  of  orthogonal  func¬ 
tions.  The  procedure  for  generation 
emphasized  here  depends  upon  the  inter¬ 
lacing  property  of  zeros  of  the  rele¬ 
vant  functions.  Other  methods  of 
generation  are  also  possible  using 
classical  techniques,  depending  upon 
the  nature  of  application  of  the  gener¬ 
ated  functions.  In  view  of  the  very 
widespread  present  day  use  of  ortho¬ 
gonal  functions  like-Haar,  Rademacher, 
and  Walsh  functions,  ’  it  might  be 
useful  to  study  these  functions  using 
network  models  obtained  from  their 
generated  functions. 
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IHEqUIVALEWT  SETS  OF  2  TWO  LEVEL  ORTHOGONAL  FUNCTIONS 

Gustavus  J.  Simmons 
Sandia  Laboratories 
Albuquerque.  New  Mexico  U.S.A. 


Introduction 

The  nth  order  Kroneckcr  product 
„  iii'Ji  /I  l\n 


5„  -  fvf  -  (I-!)" 


is  a  2n  ,\2n  matrix  vhcse  rows  (columns)  are 
the  Rademacher-Wrlsh  functions.  Much  ol  the 
utility  of  these  functions  lies  in  the  fact 
that  tney  are  a  complete  orthonr  mal  set- 
properties  which  are  preserved  in  the  equiva¬ 
lence  class  determined  by  the  operations  of: 

1.  multiplying  each  row  (column)  by  the 
same  binary  code 

2,  pel  mutiny  row-  (columns) 

i.e,  j  A  ft;  if  and  only  if  there  exist  , erauta- 
tion  matrices  P  uni  Q,  whose  nonzero  entries 
may  be  either  ±1,  such  that  A  =  PRnO,  One 
might  suspect  that  all  21‘  x  2R  orthogonal 
arrays  would  be  equi  •  lent  since  there  is  only 
one  equivalence  class  for  n  =  1,  2  or  3  [1,2], 
However,  this  is  not  the  case  as  is  illustrated 
oy  the  following  16  x  16  array  which  differs 
from  R,i  only  in  the  las*  four  rows  but  which 
cannot  be  transformed  into  K„  by  any  sequence 
of  the  operations  (l)  and  (2). 


1111 

1111 

1111 

1111 

1-1  1-1 

1-1  1-1 

1-1  1-1 

1-1  1-1 

1  1-1-1 

1  1-1-1 

1  1-1-1 

1  1-1-1 

1-1-1  1 

1  -1  -1  1 

1  -1  -1  1 

1-1-1  1 

1111 

-1  -1  -1  -1 

1111 

-i  -i  -i  -i 

1-1  1-1 

-1  1-1  1 

1-1  1-1 

-i  l-i  i 

1  1-1-1 

-1-111 

1  1-1-1 

-I  -3.  1  1 

1-1-1  1 

-1  1  1-1 

1-1-1  1 

-1  1  1-1 

1111 

1111 

-1  -1  -1  -l 

-1  -.V  -1  -1 

1-1  1-1 

1  -1  1  -1 

-1  1  -1  1 

-1  1-1  1 

1  1-1-1 

1  1-1-1 

-1-1  1  1 

-1-1  1  1 

1-1-1  1 

l  -1  -1  1 

-111-1 

-1  1  1-1 

111-1 

-1  -1  -1  1 

-1  -1  -1  1 

1  1  1-1- 

1-111 

-1  1  -1  -1 

-1  1  -1  -1 

1  -i  1  1- 

11-11 

-1  -1  1  -1 

-1  -1  1  -1 

11-11- 

1  -1  -1  -1 

-1111 

-1111 

1  -3  -1  -1- 

Since  the  invariants  of  two  dimensional  pat¬ 
terns  under  plane  transformations  are  dependent 
on  the  coordinate  system  in  which  the  pattern 
is  represented,  the  determination  of  ir.equiva- 
lent  bases  of  2n  two  level  functions  is  impor¬ 
tant  in  many  applications,  especially  in  pattern 
recognition  studies.  This  paper  develops  a 
theoretical  basis  for  constructing  these  bases. 

The  indexing  system  used  in  thin  paper  to  re¬ 
late  a  linear  vector  to  a  two-dimonsionai  pat¬ 
tern  was  selected  so  that  Ci  uncation  of  the 
vector  would  result  in  a  lower  order  pattern. 

The  leftmost  symbol  of  the  vector  is  raappea  into 
the  upper  left  corner  of  the  pattern,  the  next 


symbol  into  the  square  to  its  right,  etc.,  until 
the  2x2  upper  left  square  is  filled.  The  2x2 
square  to  the  right  is  then  filled  in  the  same 
manner,  etc.,  until- the  pattern  is  complete;  *.6., 

X  = 

becomes 

*1  *2  x5  X6 
x3  y.k  x?  x6 

*9  X10X13X1<* 

*11  *12  x15  *16 
Group  properties  of  Rn 

Many  of  the  combinatorial  properties  of  the 
arrays  Rn  are  a  consequence  of  the  fact  that 
the  rows  are  also  elements  of  a  multiplicative 
involutory  group  cf  order  2n, 

Since  there  is  no  possibility  of  confusion, 
we  shall  represent  both  the  array  and  the  group 
by  Rn.  The  group  multiplication  is  defined  by 
an  element  by  element  composition  in  GF(2)  which 
can  be  replaced  by  an  equivalent  operation  on 
the  literals  u  anu  v  in  'hose  cases  in  which  the 
product  is  between  rows  of  Rn  which  are 
designated  by  products  of  u  and  v.  For  example, 
(>pr)  •  (uvuv)  =  uvu^,  etc.  un  is  the  identity 
for  Kn.  Obviously,  every  element,  J  is 
its  own  * averse 


i.e.,  all  elements  except  the  identity  are  of 
order  two,  which  is  the  definition  of  a r. 
involutory  group.  All  involutory  groups  arc 
necessarily  abelian. 

Since  every  element  ri  of  Rr,  (r^  i  un)  is  of 
order  two; 

4  K  <u“»ri>  ri  5  Rn 

is  a  rut  group  of  cf  order  tvo.  There  are 
2n-L  such  subgroups.  If  Gp  is  extended  by  any 
other  element  rj,  r^  /  r.,  the  new  rub group  is 
of  order  h,  and  tbe  number  of  subgroups  cf 
order  6  is 


t  (0l, . 


!“;l  -  ‘ 


This  method  of  generating  subgroups  can  be 
generalized  to  all  orders  2tt,  a  <  n.  If  a 
independent  generators  are  to  be- selected,  the 
first  can  be  selected  in  2n-l  ways,  the  second 
in  2n-2  ways,  e*c.  But  the  ordering  of  the  a 
generators  -an  be  effected  in  (3*2—1)  ways  for 
the  first,  (2a-2)  for  the  second,  etc.  The 
number  of  subgroups  of  order  2a  in  Rn  is 


Theorem  2 


therefore  giver,  by  the  well-known  formula  [3]; 


#  (0  )  -  (2a-iJ.(2n-a).(2n-1t)»»(gn"att~1) 

1  (2C'-l)(2a-2)(2a-4)***(2a-2a_1) 

where 

ICjl  =  2° 


(3) 


The  vectors  with  norm  1,  i.e.,  points  on  the 
surface  of  tne  unit  hypersphere,  we  call  figures. 
If  they  are  also  a  vertex  of  the  unit  hypercube 
centered  at  the  origin  with  edges  parallel  to 
the  coordinate  axes  we  call  the  figure  a 
*  pattern,  i.e. ,  a  pattern  is  one  of  the  2n 
oinary  vectors. 


All  of  the  suogroups  of  are  necessarily 
direct  products  of  subgroups  of  order  two,  i.e., 
if  ri  /  rj 

(i,ri)  x  ^1,r^  °  ^ri’rj’rirj) 

since  Rn  is  an  Jnvolutory  group.  We  define  a 
vector  function  Pe  on  the  elements  of  a  set  G 
of  rows  from  Rn: 


where 

|S|  =  N 

In  particular  Equation  (4)  reduces  to  the 
following  for  the  Jth  element  of  the  vector; 

p.o) = 1  -  2:-n  n  (1  -  -A'))  (■■>) 

rr;s 

Theorem  1. 

Ps,  as  defined  by  Equation  (4),  is  a  pattern. 

Proof:  If  any  ^  has  a  +1  entry  at  the 
position,  the  corresponding  factor  (l  -  r^(j)) 
in  Equation  (5)  is  zero  and  consequently  the 
entry  in  Ps  is  a  +1.  If  all  r.  entries  in 
the  position  are  -1,  the  product  in 
Equation  (5)  is  2*',  and  the  entry  in  Ps  is 
a  -1.  But  any  vector  with  only  ±1  entries  is  a 
pattern. ■ 

Corollary  1. 

Obviously,  Ps  has  a  -1  entry  if  and  only  if 
all  of  the  corresponding  positions  in  the  rj 
are  -1. 


Corollary  2. 

If  | Si  =  1,  Pg  =  r£  where  S  =  {r^}. 

Corollary  2  shows  that  the  set  S  must  contain 
more  thun  one  element  if  PE  is  to  be  a  pattern 
not  already  in  S. 


* 

Professor  D.  R.  Morrison  of  the  University 
of  Hew  Mexico  has  f.Mggeeted  that  this  be  colled 
a  generalized  circle  function  because  of  its 
similarity  to  the  classical  relation  among  the 
nth  roots  of  unity. 


The  pattern  PE  i6  orthogonal  to  [R  -  [S]} 
and  is  not  orthogonal  to  any  element  in  [S], 
for  J  S|  >1. 

Proof:  From  Equation  (4)  we  see  that  Pb  can  be 
expressed  as  a  linear  comb? nation  (uniquely 
since  Rjj  is  complete)  of  terms  in  in  the 
form: 


The  proof  of  Theorem  2  follows  immediately  from 
Equation  (6)  by  noting  that 

(pE,n)=^~i^°  for  N  >  1 

Every  element  in  [S]  is  a  product  of  elements 
S,  however  every  such  product  appears  in  the 
sracketed  expression  of  Equation  (6).  Remember¬ 
ing  that  the  rows  r^  are  elements  of  Rn,  and  as 
such  are  orthogonal  by  pairs  we  get  finally: 

r  €  [S]  ,  r  ^  un 

implies 

(Ps,r)  =  {  C  for  any  N. 

C 

Similarly,  if  r  5  fRn  -  [S]},  then  (Ps,r)  =  0 
since  all  of  the  inner  products  under  the 
summation  signs  in  Eouation  (6)  are  identically 

O.B 


p  partitions  R„  into  those  elements 
s 

orthogo.  il  to  P,  and  those  which  are  not;  i.e., 
the  subgroup  [sU  generated  by  S.  We  wish  to 
strengthen  this  construction. 

Lemma:  If  the  subset  S  contains  any  two  elements 
r,  and  rj  and  their  product  r.r,,  then  Ps  is 
identically  un. 

Proof:  By  Corollary  1  to  Theorem  1,  Ps  has  a 
-1  entry  if  and  only  if  all  of  the  factors  in 
Equation  (5)  are  -1,  however,  it  is  impossible 
for  r^,  r  j  and  r^<  to  be  simultaneously  -1. 
Therefore  PE  is  +1  in  all  positions  if  the 
product  of  any  tvo  elements  in  3  is  also  in  S.B 

If  PE  =  un,  the  construction  given  above  does 
not  lead  to  any  elements  not  in  S  already— 
which  was  the  reason  for  introducing  PE  in  the 
first  place.  We  can  complete  the  development 
by  placing  appropriate  constraints  on  the  sub¬ 
set  S.  Since  [S]  is  a  subgroup  of  Rn,  ve  know 
that  its] |  =  2a  where  a  >  1  when  js|  >1. 
Furthermore,  since  Rn  is- an  involutory  group  it 
is  possible  to  selco*  a  generators  for  [S]  from 
[Sj.  In  fact  there  are  Q  sets  of  generators 

Q  =  (  2a-l )  (  2a  -2  )  (  2a-22  )  •  •  •  ( 2a-2a'1 ) 
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Given  any  subgroup  G  C  Rn,  ve  define  a 
generator  set  p'  with  lo gg  |g|  elements  in  it. 

P q  is  the  vector  function  Ps '  given  by  Equation 

ih).  Pq  has  the  following  properties,  where 
g|  >h: 


1.  P_  is  a  pattern 

Lr 

2.  If  g  f  G, 

(PG,e)  j*  o 

3.  If  h  €  (R„  -  G] 
(PG,h)  =  0 


Theorem  1 


Theorem  2 


Theorem  2 


4.  P-  i  R 

u  n 

Point  (1,)  follows  since  PG  £  {Sn  -  g],  and 

<vun)  =  ^^  Vu“ 

ana  if  g  €  G,  g  /  un 

\PG>e)  =  pjrr  =>  PG  ^  6 

i.e. ,  Pq  ^  G. 

Theorem  3. 

The  inner  product  commutes  with  the  vector 
product  if  there  is  a  common  factor: 

(xy,zy)  =  (x,z)(y,y)  =  (x,z) 

Theorem  3  is  useful  primarily  because  it 
leads  to  the  following  corollary  concerning  PG. 

Corollary  J. 

If  G  is  a  subgroup  of  P^,  |g|  >  4,  and  if 
g,h  €  0,  g  ^  h,  thenj 

(gPG,hPG)  =  0 

and  further  if  g  €  G,  and  h  €  {Rn  -  G} 

(gPG,h)  =  0 

Proof:  The  first  part  of  the  corollary  follows 
by  letting  y  =  PG  in  Theorem  3»  The  second 
part  is  a  simple  consequence  of  Theorem  2  and 
the  fact  that  G  is  a  group.  Theorem  2  showed 
(in  its  proof)  that  PG  could  be  expressed  as  a 
linear  expansion  in  terras  of  the  elements  in  G, 
and  hence 

(PG,h)  =  0 

if  h  f  {Rn  -  G}.  But  g?G  is  still  a  linear 
expression  in  terms  of  the  elements  of  G,  and 
therefore 

(gPG,h)  =  0 

if  6  f  6  and  h  t  (Rn  -  G].B 

The  preceding  corollary  is  fundamental  to 
much  of  the  following  development,  so  we  shall 
digress  for  a  moment  to  illustrate  the  con¬ 
struction,  Let  G  =  (u^,vu2v,u2vu,vuv2} 


■  w.  = 

u4  vu^v  u2vu 


Subgroup  G 

and  let  S  =  {vu^v  and  u2vu},  then  PG  is  the 
vector 

111-1  111-1  11-11  11-11 
or  the  pattern: 


with  the  spectrum  (in  F.n): 

PG  =  #1  0  1  0,  0  0  0  0,  0  1  0  -1,  0  0  0  0)  . 

The  coset  gPG;  g  €  G  is  shown  by  the  following 
figure: 


0 


(vu2v)PQ  (u2vu)Pq  (vuv2)Pq 


It  is  easily  verified  that  these  patterns  are 
mutually  orthogonal. 


I G |  =  2a 

the  number  of  cosets  of  G  is  2n"a.  The  cosets 
of  G  possess  a  very  useful  property,  summarized 
in  the  following  theorem. 

Theorem  4, 

Let  x  €  (Rn  -  G),  and  Gx  be  the  coset  formed 
by  x  on  G.  Similarly,  GPg  is  the  coset  formed 
by  PG,  The  set  of  patterns  xGPG  have  the 
following  properties 

1.  If  g,h  €  xCPG  g  /  h 
then  (g,h)  =  0 

2.  If  g  €  xGPq  and  h  €  (Rn  -  Gx] 
then  (g,h)  =  0 

Proof:  First,  it  is  obvious  that  \GPg  consists 
of  patterns,  and  not  figures,  since  the  product 
of  patterns  is  a  pattern.  If  g  and  h  are 
elements  of  xCPG,  they  must  be  of  the  form 

g  xgnP_  )  * 

V5  e  G 

h  =  xg^  ) 
and  therefore 
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(e,h)  =  fasjfgix&jpjj) 

=  (e1xPG»g2xPG) 

=  (g^gg)  ty  Theorem  3 

s*  0 

since  G  c  Rn  and  Gi  ^  gg-  The  second  part  of 
the  proof  is  somewhat  more  difficult.  Again 
since  g  €  xGFQ,  ve  have 

g  **  xgjPG  ;  ^  €  G 

and  since  h  €  [Rn  -  Gx} 


There  are  two  cases  to  be  considered;  h  f  G 
(which  is  possible  since  G  fl  Gx  =  p  when 
x  €  {Rn  -  G})  and  h  €  yG  where  y  €  {Rn  - 
(GUGx)).  If 

G  U  Gx  =  R 

n 

i.e,,  if  [ G j  rr  2n-^,  then  there  cannot  be  an  h 
of  the  second  type. 

Case  I  h  €  G 

(h,xglPG)  =  (g^xg^) 

where  gl,  g2  €  G,  since  G  is  a  subgroup.  By 
Theorem  3 

(h,xeipG)  =  (e2>xrG)  =  (xxg2,xPG) 

using  the  fact  that  the  group  is  lnvolutory. 
Therefore, 

(h>xgjPG)  =  (xggjPg)  =  (r^.jPy) 

where  rA  =  xgg  €  Gx,  i.e.,  rp  6  {Rn  -  g}.  But 
we  have  already  proven  in  the  corollary  to 
Theorem  3  that  this  last  inner  product  is  0; 
therefore , 

(hjXg^)  =  0 

Case  II  h  g  (Rn  -  (GU  Gx)] 

(h,xgipG' = 

where  gl  €  G  and  y  €  {Rr,  -  (G  U  Gx)} 

(Me^g)  =  (xh,g1PG) 

We  must  show  that  xh  £  G,  i.e.,  that 

xh  (  {Rn  -  G}.  But.  we  know  by  construction 

that 

h  €  {R„  -(GU  Gx)} 

therefore 

xh  €  {Rn  -(GUGx)Jc  (Rn  .  g} 

since  x  =  r^  €  Rn.  And  finally  oy  use  of  the 
corollary  to  Theorem  3  again  we  find 

(hjxg^)  =  0  .■ 

Theorem  4  is  the  essential  result  needed  to 
construct  inequivalent  bases  for  the  pattern 
space.  The  theorem  says  that  we  can  take  any 
subgroup  G,  of  Rn,  form  the  set  of  patterns  GPg 
and  then  replace  the  coset  Gx  of  Rn  with  a  new 


set  of  orthonormal  pattern  vectors  xGPq  and 
still  have  a  complete  orthonorraal  basis.  This 
result  is  true  in  general  since  no  restriction 
was  made  on  which  coset  Gx  was  to  be  selected 
except  to  insist  that  it  be  a  proptr  coset— 

Gx  G.  This  guarantees  that  the  procedure  just 
described  will  generate  new  bases,  however, 
these  may  be  equivalent  so  we  require  finer 
techniques  to  deal  with  the  problem  of  generating 
inequi valent  bases. 

We  digress  from  the  main  development  for  a 
moment  to  give  some  results  which  help  explain 
the  construction  of  Theorem  4.  We  noted 
earlier  in  connection  with  the  development  for 
Theorem  3  that  Pq  has  2n_a  -1*8  in  it  where 
a  -  |s|  and  S  was  any  one  of  the  generating 
sets  for  G.  We  now  note  a  suprising  result. 

Corollary 

In  spite  of  the  fact  that  Pg  has  only  2n~a 
-l*s,  all  of  the  replacement  vectors  (for  Gx) 
in  xG?g  have  2n_1  +1*8  and  2n_^  -1*8. 

Proof:  We  could  prove  this  directly,  however, 
we  have  alreedy  proven  in  Theorem  4  that  any 
element  of  xGPq  Is  orthogonal  to  any  element  of 
G,  and  hence  to  un  in  particular.  But  un 
consists  of  2n  +l*s,  and  any  vector  orthogonal 
to  it  consists  of  half  +l's  and  half  -l's.B 

The  example  which  we  used  earlier  was 


which  has  three  proper  cosets 

_  r  2  2  2  4, 

=  luvu  ,v  uv,uv  u,v  ] 

00  2  2i 

Cg  =  {vu  jU 'vjVUVUjU  v  j 

2  2  *_o 

Cj  =  [v  u  ,uvuv,v3u,uv3} 

Consider  coset  C^  and  the  associated  set  of 
replacement  vectors,  say  (uvu^GPq; 

I  V  %  K 

UVU2  V^UV  UV^U  V1 

B  BE  '4 

(uvu2)P0  (vhiv)PG  (uv2u)Pg  (v!+)Pg 

(uvu2)GPg 

(uvu2)gPq„  exhibits  all  of  the  properties  which 
we  have  derived  for  the  replacement  sets. 
However,  we  selected  C^  as  our  example  because 
it  contains  uvu2  which  is  the  third  row  in  the 
block  normalized  Rc  array.  We  wish  to  determine 
whether  the  new  array  obtained  by  replacing  Cj. 
by  (uvu2)GPq  can  also  be  put  in  block  normal 
form.  The  following  arrey  exhibits  r^  and  r2, 
rif  and  rj  and  (uvu-)GPg  to  illustrate  the  pro¬ 
cedure  for  constructing  the  permutation  which 
will  return  the  array  to  block  normal  form. 
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1 

i 

i 

1 

i 

i 

i 

i 

i 

i 

i  i 

i 

i 

i 

i 

1 

i 

i 

•t 

i 

i 

i 

i 

-i 

-l 

-l  -i 

-i  -i 

-i  -i 

1 

i 

-i 

-i 

i 

i 

-l 

-l 

1 

i 

-l  -l 

i 

-i  -i 

1 

-i 

i 

-i 

i 

-i 

i 

-l 

1 

-l 

i  ~i 

i  -i 

i  -i 

r 

"T 

i 

-i 

"-T 

-l 

"T 

i 

~T 

-i  -i 

i  -i 

i 

-i 

i 

i 

-i 

i 

-i 

-l 

-l 

i 

i  i 

i  -i 

-i  -i 

i 

i 

-i 

i 

-i 

-l 

i 

-l 

i 

i 

i  -i 

-i  -i 

-i 

i 

i 

-i 

-i 

-i 

-i 

i 

i 

i 

-i 

i 

-i  -i 

i  -i 

i 

i 

Since  xGPg  is  to  be  substituted  for  xG,  (uvu2)PG 
is  in  the  new  array.  The  other  rows  of  xGPg 
could  be  used  equally  well  however  the  method 
is  valid  in  general  irrespective  of  which  coset 
is  replaced.  If  columns  4  and  8  are  interchanged 
and  columns  11  and  15  the  rows  r^,  r2,  rj,  and 
r^  will  be  unaffected  and  the  row  labeled 
iwi^Pq  will  have  been  transformed  co  be  uvu2, 
i.e.,  by  bringing  the  permuted  row  v4  to  row 
three  we  have  returned  the  array  to  block 
normal  form.  In  the  next  theorem  we  shall 
prove  that  this  was  not  a  coincidental  property 
of  the  construction,  but  rather  a  consequence 
of  including  a  row  from  the  first  n+1  rows  of 
the  block  normal  form  in  G. 

In  the  following  discussion  we  shall 
frequently  wish  to  refer  to  the  block  of  n+1 
row6  at  the  top  of  a  block  normalized  array. 

Since  these  rows  have  a  fixed  form— independent 
of  the  structure  of  the  array  in  which  they 
occir— we  can  properly  refer  to  the  block  Bn 
as  the  first  n+1  rows  in  the  block  normal 
ordering.  Also  since  most  of  the  remaining 
discussion  is  concerned  with  the  orthonormal 
set  of  vectors  generated  by  replacing  the 
cooet  Gx  in  Rr  with  the  set  of  vectors  xGPG, 
we  need  a  symbol  for  this  array.  Let 

Q(Gx)  =  Rn  U  xGPg  -  Gx 

which  is  a  complete  specification  of  the  array 
since  both  xGPq  end  Gx  depend  only  on  the  subset 
G  and  on  some  element  x  from  the  coset. 

The  main  theorem  which  restricts  the  cosets 
so  that  the  Q  are  inequivalent  bases  can  now  be 
given. 

Theorem  5. 

If  the  coset  Gx  which  is  replaced  with  the 
vector  set  xGPg  to  form  Q(Gx)  includes  an 
element  b  £  En,  then  Q(Gx)  can  be  put  in  block 
normal  form  by  an  appropriate  permutation  of 
its  rows  and  columns. 

Proof: 

Case  I 

If  G  does  not  contain  a  farm  involving  b,  then 
PG  is  a  linear  combination  of  terras  not  involving 
b  and  which  can  therefore  be  permuted  in  any  way 
which  does  not  affect  {B-b},  One  of  these 
permutations  represents  each  term  in  bGPg,  and 
therefore  to  can  return  Q(Gx)  to  block  normal 
form.* 


As  was  shown  in  the  preceding  example  any  of 
thp  elements  (uvu2)Pq,  ( v^uvJPq,  (uv^u)Pg  or 
( v"' )Pq  could  have  been  permuted  to  return  Q(Gx) 
to  block  normal  form. 


Case  II 

If  G  contains  a  term  (or  terms)  which  involve 
b  as  a  factor,  we  must  use  a  different  argument. 
First,  we  illustrate  this  case  with  an  example. 

As  before  let 

G  =  (hi'W'VWV 

however,  form  the  coset  Gbg 

Gbg  =  (bgjb^jbgb^jb^b^)  . 

In  this  case  both  b2  'v\  bj  are  removed  from 
the  array  in  forming  Q(Gx)  since  both  are  in 
the  coset  Gbjs.  Therefore  PG  is  not  a  linear 
combination  of  terms  of  B  remaining  in  Q(Gx) 
and  no  permutation  is  possible  on  fcGPG  to 
return  Q(Gx)  to  block  normal  form.  Instead,  wo 
use  the  following  procedure.  If  |G|  <  2n_1, 
then  0  and  Gb  did  not  exhaust  Rn  and  there  is 
at  least  one  bj  €  B  which  does  not  appear  in 
either  G  or  Gb2.  The  products  bjbj.,  bjb^bjg... 
where  the  b.  are  the  elements  of  B  which  appear 
in  Gt>2  are  therefore  in  the  set  {Rn  -  G  U  Gb2}  c 
Q(Gx).  But  these  terms  can  be  simultaneously 
permuted  to  recover  the  b.  without  affecting 
the  rows  of  B  d  Q(Gx)  in  the  same  manner  as  was 
done  with  PG  in  Case  I.H 

In  the  example  given  in  the  discussion  of 
Case  II  in  proving  Theorem  5  we  had 

B  0  Q(Gx)  =  bj  ,b3,b4 

with  bg  and  b,-  as  elements  in  the  ccset,  We 
derive  the  normalizing  permutation  for  thir 
case  to  illustrate  the  method,  bgtj  =  u^v2 
and  bgb^bt;  =  vuv2  are  both  in  Q(Gx).  The  first 
three  rows  of  the  following  array  are  b) ,  b^ 
and  b)t  and  the  last  two  are  bgbj  and  t^t^bj. 


iiii 

1111 

1111 

1111 

i  i-i-i 

i  i-i-i 

i  i-i-i 

i  i-i-i 

i  i  i  i 

-i  -i  -i  -i 

1111 

-i  -i  -i  -i 

i  -1  -i  i 

i-i-i  i 

i-i-i  i 

r^L  -i  i 

i-i-i  i 

i-i-i  i 

-i  *  i-i 

-lii-i 

The  column  permute.tion  to  convert  b2bob^  to  bj 
and  bpbj  to  b2  simultaneously,  while  leaving 
bj_,  bj  and  b;(  unchanged  is 

(1)(2,10,9)(3,12,4)(5)(6,H*,13)(11)(?,16,8)(15). 

This  permutation  is  completely  determined  by  the 
choice  of  elements  in  Q(Cb)  which  are  to  be 
reordered.  We  could  have  equally  well,  selected 
bjbj  or  b2bjbj,  but  we  could  rot  select  b2bil 
since  it  was  an  element  of  Gb2  and  therefore  not 
in  Q(Gb). 

Theorem  5  defines  the  problem:  to  determine 
those  arrays  Q(Gx)  generated  by  the  replacement 
of  cosets  for  which 

B  0  Gx  =  p  .  (7) 

Cosets  for  which 

b  n  gx  tp 

we  shall  call  denied,  in  the  sense  that  the 
arrays  which  they  generate  can  be  reduced  to 
some  other  Dlock  normal  form,  i.e,  they  cannot 
be  inequivalent  block  normal  arrays. 
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Subgroup  structure  of  Rn 


Subgroups  of  Rij  of  order  4 


Theorem  5  of  the  preceding  section  showed 
that  only  cosets  Gx  for  which 

B  n  Gx  =  p  (8) 

need  be  considered  in  the  search  for  inequiva¬ 
lent  bases.  In  this  section  we  shall  develop 
necessary  and  sufficient  conditions  for 
Equation  (8)  to  be  satisfied,  and  enumerate  the 
resulting  bases  for  Eqg. 

Theorem  6. 

The  only  bases  for  E2,  Ej,,  Eg  and  which 
are  also  groups  are  in  the  equivalence  classes 
of  Rq,  R2,  R3  and  Rl*,  respectively. 

Proof:  The  conclusion  is  trivial  for  E2,  E4 
and  Eg  since  the  only  bases  in  those  cases  are 
equivalent  to  R^,  Rg  and  Rg.  In  the  cast  of 
E16,  we  have  proven  that  all  bases  are  equiva¬ 
lent  to  some  normal  array,  i.e.,  an  array  which 
includes  B.  However 

[B]  =  Rn 

and  the  theorem  follows.® 

Corollary  1. 

If  the  subgroup  G  of  is  of  order  2n_1,  its 
cosets  cannot  satisfy  Equation  (8),  i.e,,  they 
cannot  be  disjoint  from  B. 

Proof:  B  f-  G,  for  if  it  were  G  would  be  Rn  by 
Theorem  6.  Therefore  the  only  coset,  Gx  G, 
has  a  non-empty  intersection  with  B 

Gx  fl  B  if  .  ■ 


Corollary  2. 

Eqg  is  the  smallest  space  which  could  have 
an  equivalent  pair  of  bases. 

Proof:  From  Corollary  2  to  Theorem  1,  we  know 
that  G  must  be  of  order  four  or  greater  if  the 
method  of  generating  new  bases  described  by 
Theorem  4  is  to  lead  to  a  new  base.  But 
Corollary  1  says  that  the  cosets  of  a  subgroup 
of  order  4  cannot  have  a  member  which  is  dis¬ 
joint  from  B  unless  n  >  4,  i.e,,  for  Eq6  or 
larger  spaces.® 

The  important  point  of  the  preceding  argument 
is  that  we  need  only  consider  the  subgroups  of 
rj,  of  order  4  in  constructing  inequivalent  bases 
for  Hqg.  Equation  (3)  gave  the  number  of  such 
subgroups  to  be  35.  These  are  tabulated  in 
""able  1. 

The  meaning  of  the  subgroup  types  eon  best  be 
illustrated  by  examples.  Consider  first,  the 
subgroup  G^  and  its  cosets: 

_  ,  4  3'  2  22, 

G^  =  (u  ,u  v,u  vu,u  v  ) 

2  2 

Gj(uvu  J  =  (uvu  ,uvuv,uv"u,uv3) 

o  o  2  2 

G^(vuJ)  =  (vu  ,vu  v,vuvu,vuv  ) 

G^V2*!2)  =  (v2u2,v2uv,v3u,v4)  . 


Subgroup 


G4 

g5 

g6 


7 

°8 

°9 

G10 

Gll 

G12 

G13 

Gl4 

g15 

Gl6 

g17 

Gl8 


19 

G20 

G21 

G22 


g24 

g25 

G26 

G27 

°28 

°29 

°30 

G31 

G-m 

4 

G34 

G35 


Composition  Type 

/  4  3  2  2  2,  T 

(u  ,u  v,u  vu,u  V  }  I 

(u  jU^VjUVU  ,UVUv)  I 

,  4  3  3  2,  T 

(u  ,u  v,vu  ,vu  v)  7. 

,  4  2  2  2  ,  T 

(u  ,u  vu,uvu  ,uv  u)  I 

j|  A  Q 

(u  ,U  VU,VU  ,VUVu)  I 


,4  2  322, 

(u  ,UVU  ,vu  ,v  u  ) 

I 

,  4  3  2  3, 

(u  ,u"V,uv  u,uvJ) 

IX 

/  4  3  2, 

(u  ,u-V,vuvu,vuv  ) 

II 

,  4  3  2  2  2  , 

(u  ,u  v,v  u  ,v  uv) 

11 

(  U1*  ,  u2  VU  ,  UVU  V  ,  U  V3  ) 

n 

,  4  2  2  2, 

(u  ,U  VU,VU  V,VUV  ) 

IT 

,  4  2  2  2  3  , 

(u  ,U  VU,V  u  ,vJu) 

II 

,  4  2  2  2  3, 

(u  ,UVU  ,U  V  ,UVJ) 

II 

,  4  2  2  2  , 

(u  ,uvu  ,vu  v,v  uv) 

II 

(u4, uvu2 , vuvu , V3U ) 

II 

,4  322  2, 

(u  ,vu  ,U  V  ,vuv  ) 

II 

,  4  3  2  , 

(u  ,vu  ,avuv,v  uv) 

II 

-3  2  "3 

(u  ,vu  ,uv  u,v:>u) 

II 

(u4,u3v,v3u,v4) 

HI 

(u4,u2vu,v2  uv,v4) 

III 

,  4  2  2  4, 

(u  ,uvu  ,vuv  ,v  ) 

in 

,  4  3  34, 

(u  ,vu  ,UV  ,v  ) 

in 

,  4  2  2  2  , 

(u  ,U  V  ,uvuv,uv  u) 

IV 

,  4  2  2  2  , 

(u  ,u  v  ,vu  v,vuvu) 

IV 

,  4  2  2  2, 

(u  ,uvuv,vu  v,v  u  ) 

IV 

,42  22, 

(u  ,uv  u,vuvu,v  u  ) 

IV 

,  4  2  2  2  ?  4, 

(u  ,u  v  ,v  u  ,v  ) 

V 

,  4  4, 

(u  ,uvuv,vuvu,v  ) 

V 

( u4 ,uv2u, vu2v, V4 ) 

V 

( U4 ,u2v2 , v2uv, v3u) 

VII 

,  4  2  3  \ 

(u  ,uvuv,vuv  ,V  U) 

VII 

,  4  2  2  2  , 

(u  ,uv  u,vuv  ,v  uv) 

VII 

(u4,uv3,vu2v,v3u) 

VII 

(u  ,uv  ,vuvu,v  uv) 

vn 

,  4  3  2  2  2, 

(u  ,uv  ,vuv  ,v  u  ) 

VII 

Table  1 


Tn^  intcr-t-*-1  c"  these  cosets  with  B  are 
given  by  the  following  expressions,  in  which 
the  coset  leader  for  cosets  2  and  3,  happens 
also  be  the  intersection. 


3b3 


G1  n  B  =  (u**,u3v,u2vu) 

G^(uvu2)  (1B=  (uvu2) 

Gy{  .u3)  n  B  =  (vu3) 

G^(v2 u2)  n  B  = 

Therefore  only  the  last  coset  can  generate  a 
non-equiv  Lent  base  for  Ej£. 

On  the  other  hand  consider  the  subgroup  G-, ~ 
and  its  cosets: 

.  O  O  h 

G19  =  (u  ,uJv,v\i,v  ) 

2  2  2 
r.ig(uvu’)  =  (uvu  ,uvuv,vuvu,vuv  ) 

o  3  2  2  3 

G1g(vuj)  =  (vu  ,VU  V,UV  UjUV5) 

„  ,  22>  ,222  2  22, 

G^(v  u  )  =  (v  u  ,v  uv,u  vu,u  V  )  . 

The  intersections  of  these  cosets  with  B  are 

GX9  fl  B  =  (u\u3v) 

G^9(uvu2)  fl  B  =  (uvu2) 

Gl9(v>*3}  n  B  =  (vu3) 

Gi9(v2 U2)  n  B  =  (u2vu) 

hence  Gj£  caiuiot  be  used  to  generate  new  non- 
equivalent  bases  for  Ei6.  Thus  there  exist 
subgroups  of  order  4  which  lead  to  new  bases 
and  others  which  do  not. 


Consider  a  general  subgroup  G  of  order  U; 

G  =  (l,a,b,ab)  (8) 

where  for  notatlonal  convenience  we  have  let  1 
represent  u\  and  a,  b  and  ab  represent  the 
other  elements  of  Rn  appearing  in  G.  A  detailed 
examination  of  the  example  with  Gig  would  have 
6hown  an  apparent  pairing  of  denied  elements  by 
members  of  a  subgroup;  for  example,  uv3  and 
vuv2  both  deny  u2v2  as  an  element  for  a  coset 
which  is  to  be  disjoint  with  B  and  both  also 
deny  \r*.  This  is  no  coincidence  as  the  follow¬ 
ing  theorem  shows: 

Theorem  7. 

If  two  elements,  a  and  b,  of  a  subgroup  G, 
when  multiplied  by  a  common  factor  x,  both  give 
products  which  are  in  B 

ax  £  B  ) 

and  >  (9) 

bx  6  B  ) 

then  there  exists  another  factor  x'  (which  we 
shall  call  the  conjugate  of  x)  which  also 
satisfies  Equation  (9) 

ax'  6  B 

and 

bx'  €  B  . 

Proof:  First  we  note  that  the  elements  of  B  ere 
either  un  or  else  of  the  form  un-ivui~l.  There¬ 
fore  if  a  f  B  and  bx  €  B,  there  are  two  possi¬ 
bilities. 

Case  I 

The  products  differ  in  two  factors: 


The  reason  for  the  different  behavior  of  Gi 
and  Gig  is  that  their  cosets  span  12  and  16 
elements  of  R^  respectively.  For  example,  if 
uvuv  is  in  G^,  then  any  coset  which  includes 
u^v,  uvu^,  uvuv,  uv3  or  v^uv  will  have  a  non¬ 
empty  intersection  with  B  and  hence  by  Theorem  5 
could  not  lead  to  a  new  base  for  Eqg.  In  the 
case  of  Gi  all  elements  other  than  v2u2,  v2uv, 
v3u  and  \r*  are  denied  as  coset  members;  but 
these  four  are  themselves  a  coset  of  Gi  which 
can  be  replaced  by  xGPq  to  form  a  new  basis. 

On  the  other  hand  G^g  spans  all  elements  of  RJ, 
and  no  such  coset  is  possible. 

Every  element  in  G  has  n+1  factors  which  it 
denies  as  members  of  cosets,  since  the  product 
would  be  in  B.  The  elements  u  *  and  v*  each  deny 
5  elements  as  terms  in  cosets,  i^  the  cosets  are 
to  be  disjoint  from  B,  but  none  of  the  five 
terms  denied  by  ir*  are  included  in  the  set  of 
five  denied  by  v;.  On  the  other  hand,  and 
u3v  together  deny  only  eight  terms.  It  is  this 
overlapping  of  denied  elements  which  makes  it 
possible  for  the  four  terms  in  some  subgroups  to 
deny  only  twelve  factors,  as  was  the  case  for 
G^ ,  and  hence  to  leave  a  coset  disjoint  from  B. 
On  the  other  hand  for  a  space  of  suitably  high 
dimension,  it  is  oossibie  for  a  subgroup  of 
order  b  tc  deny  as  many  as  4(n+l)  factors.  This 
can  bg  achieved  in  Egl*,  where  the  subgroup 
(uP,u3v3,v3u3,v®)  does  deny  28  elements  (out  of 
6b).  Our  method  of  study  for  this  problem  will 
be  to  determine  how  many  denied  elements  can  be 
shared  by  a  pair  of  generators  from  a  subgroup. 


ax  =  uu>  •  >/v\  . 


bx  =  uu* • 


Q***/u\  ***i 
i'”'v/y  u 


where  i  ^  J  since  a  b.  Equation  (10)  shows 
vhat  a  and  b  must  differ  in  exactly  two  factors 
(u  and  v),  and  that  consequently  ab  differs  from 
ax  and  bx  in  one  position  for  each  case,  and 
that  ab  has  two  v*s  in  it 

ab  =  uu***(v)i*.*(v)y*uu  (11) 

Furthermore,  x  must  differ  from  a  in  the  i-th 
position,  and  from  b  in  the  J-th  position;*  i.e,, 
if  x  is  given  by: 

x  =  z  z0*  •  •  a.'*  **b  '•  •  •  z  . - 
12  a  J  n-1  n 

then  a  and  b  are  of  the  form: 

a=  z,  z_*  •  *a.  •  •  *b  :•  •  *z  ,z  ) 

12  i  J  n-1  n  / 


b  =  W 


*a.'*  •  *L  ,*  •  *z  ,z 

l  J  n-1  n 


Let  x'  be  defined  to  be  the  element: 


v  —77.* 

-  - 


*Z  -  z 
n-1  n 


C7  ss  uu***/u\ 

t7  =  uu*  •  •  \v  ♦  A  u  ly  *  *i 


which  proves  the  existence  of  the  conjugate,  x7, 
by  construction. 


%  / 

In  this  case  means  u  replaced  by  v  or  v 
replaced  by  u;  not  the  usual  complement , 
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Case  II 

The  products  differ  in  only  one  factor: 


ax  = 
bx 


=  uu*  •  •/u  \  *  •  *11 
=  un***\  v/,  •  ••u 


(13) 


then  a  and  b  differ  in  only  the  i-th  position, 
and  we  have  by  the  same  construction  used  above 

ab 


u  u  ««.v 
x  =  2 


12 


bi*”Zn-lZn 


a=  Vs—bi'— VlZn 


b  =  Z]Lz2. 


•b .•••z  ,z 
i  n-1  n 


The  conjugate  *n  this  case  is 

x'  =  a, z  •••b  •••z  ,  z 
12  i  r.-l  n 

and  we  have  the  pair  of  identities 

ax  =  bx '  J 

bx  =  ax '  | 

which  proves  the  theorem.  ■ 


(15) 


There  are  sr  eral  corollaries  based  on  the 
argument  used  in  proof  of  "heoren  7.  These  foim 
the  basis  of  the  next  several  theorem?. 

Corollary  1.  . 

If  and  b  are  both  elements  of  B,  a  ^  b,  then 
ab  £  B.  This  follows  from  Case  I  above  since 
ab  must  have  two  v*s  in  it,  and  hence  is  not  in 

B. 


Corollary  2, 


2 

differ  between  a  and  b.  For  example,  if  a  =  u  v 
and  b  =  uvu,  d(a,b)  =  2,  It  is  easy  io  show 
that  d(a,b)  is  a  distance  function. 

Theorem  8. 

If  a,b  6  C,  C  c  Rn,  and  d(a,b)  =  k,  then  for 
any  x  6  G 

d(ax,bx)  =  k 

Proof:  Theorem  8  is  a  consequence  of  u  and  v 
being  elements  of  a  group  so  that  if  in  the  i-th 
position  a  and  b  were  alike  (unlike)  then  ax  and 
ab  are  also  alike  (unlike)  in  the  satoe  position.® 

There  can  only  be  2a-l  independent  distances 
in  a  subgroup  of  Rn  with  a  generators  in  view  of 
Theorem  8.  For  example,  in  G  =  (l,a,b,ab} 

d(a,ab)  =  d(l,b) 
d(r.,b)  *.  d(l,ab) 
d(b,ab)  =  d(l,a)  . 

The  vertex  1,  i.e.,  u^,  will  be  chosen  as  the 
reference  point  because  it  must  be  present  in 
all  subgroups. 

Theorem  9- 

There  exists  an  element  x  6  G,  such  that 
d(l,x)  =  1  if  and  only  if  the  other  two  elements 
y  and  xy  satisfy  the  pair  cf  identities: 


Proof:  Since  d(l,x)  =  1,  x  £  fB-u11},  i.e., 
x  =  un“*vui“l.  Therefore  if 

y-  ziV"v*’Kn.r“n  <17> 

then 


If  a  and  b  are  neither  in  B,  It  is  st.'ll 
possible  for  ab  £  B,  Case  II  gives  the  necessary 
condition  for  this  to  be  true,  i.e.,  that  a  and 
b  differ  in  exactly  one  position.  An  example 
would  be 

2  ,  _ 
a  *  uv  u  f>  B 

b  =  uv3  i  B 

ab  =  u^v  £  B  . 

Corollary  3. 

It  is  possible  'or  none  of  a,  b,  or  ab  to  be 
in  B.  An  examDle  is 

2  2 

a  =  u  v 

b  =  uvuv 

.  2 
ab  =  uv  u 

Corollary  4. 

It  is  not  possible  for  a  and  b,  a  £  b,  to 
share  more  than  a  single  pair  of  denied  elements. 

This  follows  immediately  from  the  Equation  (12) 
and  (14)  which  specify  a  and  b. 

We  define  a  distance  function  on  the  members 
of  R_  similar  to  the  Hamming  distance.  The 
Hamming  distance  [4]  between  two  binary  code 
words  is  defined  to  be  the  number  of  positions 
in  which  the  code  words  differ.  Since  all  of 
the  elements  cf  Rn  can  be  represented  as  Kroneoker 
products  of  factors  u  and  v,  we  define  d(a,b) 
where  a,b  £  Rn,  to  be  the  number  of  factors  which 
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xy  = 


z172‘ 


•••7  ,Z 

n-1  n 


(18) 


If  Zi  =  u,  then  d(l,xy)  =  d(l,y)+l,  since  xy 
will  differ  in  one  more  position  than  x  from  un. 
Similarly,  if  =  v  then  d(i,xy)  =  d(l,y)-l 
which  can  be  put  in  proper  form  by  selecting 
the  terra  with  u  in  the  i-th  position  to  be  y. 


On  the  other  hand  if  y  and  xy  are  of  the  form 
given  in  Equations  (17)  and  (18)  then  x  =  y(xy) 
will  have  all  factors  a  except  the  i-th  factor, 
and  hence  x  £  (B-un}  and  d(l,x)  =  1,81 

Corollary  1. 

If  a,b  £  G  and  p,b  £  B,  then  ab  B,  This 
was  proven  earlier  but  is  trivially  apparent 
from  the  result  of  Theorem  9.  In  particular, 
d(l,ab)  =  2. 


Theorem  10. 

Then  exists  an  element  x  €  G,  such 
d(l,x)  =  2  <  d(l,g)  for  ell  g  €  6,  if  <  unly 
if  the  other  two  elements  y  and  xy  satis. y  one 


of  the  two  pairs  of  identites 

<3(1, y)  =  k  j 
d(l,xy)  =  k  1 

(19) 

or 

d(l,y)  =  k  | 

d(l,xy)  =  k+2  . 1 

(20) 

Proof:  Since  d(l,x)  -  2,  we  know  that  x  has 
exactly  two  v  factors  in  it: 


n-i-j  J-l  i-1 


Therefore  If 


y  =  vg. 


•  *7  •  •  »  «5>  • 

i+J  i 


•  z  ,  z 
n-1  n 


There  are  tvo  possibilities:  either  zi+j  and 
Zi  ar_  both  u,  or  one  is  u  and  one  is  v.  First 
assume  they  are  both  u,  then 

d(l,xy)  =  d(l,y)  +  2 

and  Equations  (20)  are  proven.  If  one  is  u  and 
one  is  v,  then 

d(l,xy)  =  d(l,y) 

and  Equations  (19)  are  proven.  By  the  same 
argument  used  in  Theorem  9  we  must  select  the 
proper  term  to  be  called  y  for  the  above  to  be 
true.  If  y  and  xy  are  of  the  form  given  in 
Equations  (21)  and  (22),  irrespective  of  whether 
Zj  and  z^+j  are  u  or  v,  the  product  is  of  the 
desired  form  for  x.H 

Corollary  1. 

There  are  subgroups  G  =  (l,a,b,ab)  such  that 
<3(1, u)  =  d(l,b)  =  d(l,ab)  =  2  (23) 

Discussion: 

Equation  (23)  is  true  by  Theorem  10  for  all 
n  >  3,  however  it  is  also  possible  to  define 
the'  precise  form  which  the  vectors  a,b  and  ab 
must  have  for  Equation  (23)  to  be  satisfied. 

If  y  and  xy  are  to  each  be  at  a  distance  of  tvo 
from  un,  then  x,y  and  xy  are  each  made  up  of 
factors  of  u  in  all  buv  three  positions  in  which 
the  factors  are 

a  u .•••v  •••v, 

i  J  k 


All  of  the  cases  of  interest  are  tabulated 
below,  as  determined  from  Theorems  9  and  10  and 
simple  combinatorial  considerations. 

Case  I  d(l,a)  =  1 

d(l,b)  =  1 
d(l,ab)  =  2 

The  number  of  such  subgroups  is: 


Ni  =(f)=  2n'1(2r'-l) 


Case  II  d(l,a)  =  1 

<3(1, b)  r  2 
d(l,ab)  =  3 

By  Theorem  8  d(l,b)  =  2  implies  that  d(a,ab)  =  2. 
But  d(l,a)  =  1,  therefore 

a  =  uu*  •  »u.  •  •  *u .•  •  *v,  •••uu 

i  j  k 


b  =  uu***v  .•••v  .•••u.  •••uu 
i  j  k 

ab  =  uu* •  •  v  •  •  •  v , •  •  •  v,  •••uu  . 

i  J  k 

The  vector  a  can  be  selected  in  2n  ways  and  any 


pair  of  the  unoccupied  positions  can  bo  used  for 
the  v  entries  in  b,  therefore  the  number  of  such 
subgroups  is: 


Case  IH 


N2  =  2fY) 

<3(1, a)  =  1 
d(l,b)  =  k 
d(l,ab)  =  k+1 


where  k  >  2.  The  number  of  subgroups  which 
belong  to  Case  III  is: 

N3  =  2n(2n-l'(2n"1-l)  (26) 

since  we  can  select  an  element  of  {B-un}  in  2n 
ways  and  we  can  then  select  an  element  with  two 
v* s  in  it,  neither  of  which  coincides  in  position 
with  the  v  in  a,  in  (2n_1-l)(2n-l)  ways. 

Case  IV  d(l,a)  =  2 

d(l,b)  =  2 
d(l,ab)  =  2 

Corollary  1  to  Theorem  10  shows  that  the  number 
of  subgroups  of  this  type  is  Just  the  number  of 
ways  in  which  three  positions  can  be  selected, 

\=(T)  w 

Case  V  d(l,a)  =  2 

d(l,b)  =  2 
d(l,ab)  =  U 

Theorem  10  showed  that  Z;  and  j  in  Equations 
(21)  and  (22)  must  both  be  u  in  this  case, 
therefore: 

N5  =  l(f)(2  22)  <28> 


Case  VI 


where  k  >  2 


Case  VII 


where  k  >  2 


d(l,a)  =  2 
d(l,b)  =  k 
d(l,ab)  =  k*-2 


%  ■  (f)  t  (a» 


<3(1, a,  =  2 

d(l,b)  =  k 
d(l,ab)  =  k 


”7  ■  (f)E  (tJ) 


<3(1, a)  =  \ 
d(l,b)  =  d2 
d(l,ab)  =  dj 


<3i  >  2  . 

If  n  <  6,  there  are  no  examples  of  Case  VIII. 
The  smallest  such  example  is; 


Case  VIII 
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a  =  uuuwv 
b  =  wvuru 
ab  =  vwv.' 

The  simplest  way  to  express  the  number  of  sub¬ 
groups  belonging  to  Case  VIII  is 


n8  = 


_  (gn-D(gn~i-i)  _  ^  Ni 

i=l 


(31) 


The  classification  of  the  subgroups  of  Rn  of 
order  4  into  the  eight  cases  given  above  may 
appear  arbitrary,  but  is  based  on  how  the 
elements  within  the  subgroups  share  the  elements 
denied  for  use  ...  the  constn.  tion  of  cosets 
disjoint  from  B.  We  can  now  say  just  ho;  many 
elements  an  arbitrary  subgr -ip  (of  order  b) 
denies. 


Lemma  :  If  a  €  B,  then  a  and  I  jointly  deny 
2n  elements. 

Proof:  Theorem  7  applies  since  aa  =  I,  and  the 
number  of  denied  positions  is 

2(n+l)  -  2  =  2n 

Theorem  11. 


r.ypCfRuiiiVl-Ul.e.w-wn'.-  7 r  .7^  7  -»wrvnr’  ~  7 


In  view  of  Theorem  11  only  the  subgroups  of 
Types  I,  II,  IV  and  V  can  possibly  have  cosets 
disjoint  from  B,j  in  Rj,.  Since  the  elimination 
procedure  which  we  have  developed  in  the  re¬ 
ceding  pages  actually  eliminated  coset  images, 
each  of  the  sets  of  four  undenied  elements  (fo* 
n  =  b)  is  itself  a  cosot.  The  corresponding 
replacement  vectors,  generated  usi ng  Theorem  b, 
are  shown  in  Figure  1  each  of  which  generates  a 
non-equivalent  (to  Rn)  basis. 

Concluri on 


A  general  technique,  dependent  on  the  sub¬ 
group  structure  of  Rn  considered  as  a  multi¬ 
plicative  involutory  group,  has  been  developed 
w.'iich  can  be  used  to  construct  inequival ent 
bases  for  Egn.  The  theory  was  applied  in  the 
second  half  of  the  paper  to  a  complete 
enumeration  of  the  bases  obtainable  in  this 
manner  for  E,g.  The  method  is  applicable  to 
all  Kn,  n  >  b.  Limitations  of  space  precluded 
a  discussion  of  the  transformation  groups  o." 
the  va”ious  bases,  however,  it  should  be  noted 
that  the  invariants  of  patterns  are  in  general 
changed  by  the  coordinate  transformations  given 
here. 


If  G  is  a  subgroup  of  type  i,  then  the 
number  of  elements  denied  by  G  is  rn 


I 

b(n-l) 

II 

b(n-l) 

J.II 

4n 

IV 

b(n-l) 

V 

b(n-l) 

VI 

bn 

VII 

bn 

VIII 

b(n+l) 

Proof:  Each  case  is  proven  by  forming  the 
m>iltiplication  for  G  with  Rn  to  deter, dine  the 
shared  denied  elements  using  the  results  of  the 
last  fe-'  theorems.® 
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Abstract 

A  closed  form  representation  for  the  set  of 
Walsh  functions  is  presented,  in  terms  of  the 
sign  of  a  product  expansion  of  sines  an'"  cosines. 
This  provides  a  clear  picture  of  the  Walsh  func- 
ti  is  and  their  relationship  to  trigonometric 
functions.  Trigonometry  identities  show  the 
relationships  between  the  Walsh  functions  and  a 
simple  procedure  gives  the  Walsh  function  of  any 
argument . 

Introduction 

A  complete  set  of  orthogonal  function., 
taking  only  the  values  ±  were  presented  by 
Walsh*  in  1923.  The  functions  can  be  defined 
iteratively  or  as  products  of  the  Ridemacher 
functions,  a  subset  of  the  Walsh  functions. 

Herein  is  presenced  a  general  closed  form  rep¬ 
resentation  of  Walsh  functions  in  terms  of  the 
sign  of  a  product  expansion  of  sines  and  cosines. 
The  product  form  present  d  manes  periodic  con¬ 
tinuation  of  the  Wul  motions  easy  to  visu¬ 
alize,  graph,  and  manipulate. 


Trigonometric  Expression  of  Walsh  Functions 

Consider  the  set  of  Walsh  functions, 
{val(j,x)},  where  J  indicates  the  Walsh  furnticn 
index  and  x  is  the  argument.  They  form  a  com¬ 
plete  set,  orthogonal  in  the  interval  <_x<  j- 
and  zero  elsewhere.  This  normalized  interval 
can  be  converted  to  the  general  interval  -T/2^_ 
x<T/2  with  x  replaced  by  x/T,  as  required.  The 
general  expression  for  wal(j,x)  is  bas.ed  on  bi¬ 
nary  representation  of  the  index  J,  i.e., 

(1) 


J  2n+1  2n-1+ 

Jn*1  Jn-j^ 


+  Ji2l+Jo2° 


where  Jj  =  9  or  1,  so  that 

wal(j,x)  =  sigr.[(sin2TTx)^°  H  (cos2knx)^l  (2) 

k=l 


The  sign  function  is  similar  to  the  sigiun  func¬ 
tion  except  that  it  takes  the  value  zero  only 
when  the  limit  from  the  right  is  not  equal  to 
the  limit  from  '•he  left. 

The  even  and  odd  Walsh  functions  of  ca 
(i,x)  and  sal(i,x)  are  easily  found  from  ( 2 ) 
using  the  relations  cal(i,x)=wal(  2i  ,x)  and  sa. 

( i,x)=wal(2i-l ,x)  and  writing  the  indices  2i  and 
2i-l  as  binary  numbers  as  in  (l).  We  note  that 

n  v+l  *k 

cal(i,x)  =  sign(kflo(cos2  nx)  ]  (3) 

To  express  sal  (i,x)  in  terms  of  index  i 
we  must  specify  the  binary  representation  of  i 
a?  follows.  Let  the  lowest  binary  coefficient 
of  i,  not  equal  to  zero,  be  is,  so  that  is  =  1. 


is-l  =  is-2  =  ...  =  in  =  0.  Then  by  direct  sub¬ 
stitution  in  (2)  and  combining  terms 

sal(i,x)=.--ign[(sin2S*^rx)  R  (cos2lt+^zx)  ^(b) 
k=s+l 

Equations  (2),  (3),  and  (*4)  completely  define  the 
Walsh  functions,  ordered  by  sequency,  orthogonal 
in  the  interval  -  A-  <_x<  ]r  and  also  periodically 
continued  from  this  interval  over  the  real  axis. 
Example 

As  an  example  consider  the  construction  of 
the  function  val  (9,x)  =  sal  (5»x).  In  binary 
form  j  =  9  =  1001  i  =  5  =  101.  Then 

wal  (9.x)  =  sal  (5,x)=sign[sin  2itx  cos  8vx) 
which  is  illustrated  in  Figure  1. 

The  general  expression  given  in  (2)  is 
proved  by  mathematical  induction  using  Harmuth’!? 
iterative  difference  equation  for  the  Walsh 
functions.  This  is 

wal(2,1+p  ,x)=(-l)'  ^2^+P{val[  j,2(x+  t^-)] 

+(-i)J+P  wal[j,2(x-  £-)]}  (5) 

where  p  =  0  or  1  J  =  0,1,2,...  [j/3=  integer 
value  and  wal(o,x)  =  1  for  -J*  £_x<  £■ 

wai(o,x)  =  0  for  x<-  \  ,  x>  . 

Equation  *5 4  is  separated  into  two  parts, 
one  valid  for  -  f  _x<0  and  the  other  for 
0<x^_  .  The  proof  enzails  four  separate  cases, 

corresponding  to  p=0,l  and  JQ=  0,1,  as  stated. 
Direct  substitution  of  I?)  into  (5)  under  the 
above  conditions  proves  that 

wal(2J+p,x)=sign[  (sa.ri2nx)P  II  (cos2*c+'*'iix)  ]  ^ 

k=o 


which  is  tl ‘  required  result  for  the  induction 
proof 

Application 


Some  basic  properties  of  the  Walsh  func¬ 
tions  are  evident  from  (2),  such  as  wal(J,x)  is 
an  even  ‘\ocction  of  x  when  j  is  even  (equal  to 
calO/2,x),  and  an  odd  function  of  x  when  J  is 
odd  (equal  to  sal(  ,  x)).  Also  the  rela¬ 
tionships  between  the  even  and  odd  Walrh  func¬ 
tions  are 


val(2i+l,x)  =  walUi,x);  x>o 

=  -  wal(2i ,x) ;  x<c 


IT) 


and  sal(i+l,x)  =  cal  ;  x>j 

-  -  cal(i ,x) ;  x<o  . 

The  value  of  .  .  satisfying  the  following 
period!'  relationships  of  the  Walsh  function. 
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can  easily  be  found  from  (3)  and  (It). 


cal(i,x+x0)  =  sal(i,x)  (8a) 
sal(i .x+x^)  =  cal(i,x)  (8b) 
cal(i,x+Xi)  =  -  cal(i,x)  (8c) 
sal(i,x+::^)  =  -  sal(i,x)  (8d) 
cal(i,x+x2)  =  cal(i,x)  (8e) 
salU.x+x,!!,)  =  sal(i,x)  (8f) 


For  example  consider  relation  (8a)  when  the 
lowest  binary  coefficient  of  i  not  equal  to  zero 
is  is.  For  this  value  of  i  substituted  into  (3) 
ve  obtain 

cal(i,xi|xj  ) 


We  must  determine  the  sign  and  magnitude  of  x  , 
which  depends  on  s,  so  that  (9)  becomes  'J 

cal(i,x) 

=  sign( (sin2J+1nx)  n  (cos2k+^r:x)  K)(10) 
k=s+l 

This  can  be  done  by  equating  the  product  expan¬ 
sions  in  (9)  and  (10)  term  by  term.  Equating 
the  first  terms,  i.e.,  k=s  in  (9)  and  sin  2s*1nx 
shows  that  |x0|-  2-s~2  is  the  smallest  |x  |  sat¬ 
isfying  the  equality  and  is  enalagous  to  8he 
principle  value  in  trigonometric  functions. 
Substituting  this  value  of  x0  into  (9)  yields 
the  equacion 

cnl(i,xt|xj  J  j 

=  sign  [  (+l)(sin2~'+1Ttx)(-l)  s+i 

ii  (cos2k+17tx)  11  j  (11) 

k=s+l 

To  make  (10)  and  ( 1 1)  equal  we  see  that  the  sign 
of  x  must  be  chosen  according  to  the  value  of 
is+l,  i.e.,  if 


i  .  =1 ,  when  x  =+2 
s+1  ’  o 

i  ^,=0,  then  x  = 
s+1  o 


-s-2 


w-s-2 


(12) 


This  relationship  is  equivalent  to  the  one  des¬ 
cribed  by  Harmuth.2  A  similar  development  for 
(3b)  yields  the  relationships 


if 

and  if  i 


i  .,“1,  then  x  - 
s+1  ’  o 


,.-s-2 


(13) 


. .=0,  then  x  =  +2 
s+i  ’  o 


(3c)  to  (8f ) ,  the  relations  are 


xrxr±2 


-s-l 


and  Xg=x2=*2 


In  g-.neral,  any  desired  periodic  relationship 
for  tht  Walsh  functions  can  be  found  using  the 
rr  'Jr  t  .  xpansion  dts'-.  ed  in  tne  paper. 

tie  frcduct.  rule  for  muitiolicrtion  of 
Wale1  .  .  "-.castrated  using  (2). 


From  (2)  we  obtain 
wal(  j  ,x)wal(h,x) 

=  sign[(sin2nx)^°  H  (cos2k7ix)^k] 
k=l 

•sign((sin27ix)h°  n  (cos2Ktjx)  k]  (15) 
k=l 

where  n>r, 1 . 

Now  we  may  combine  the  right  hand  side 
and  obtain 


wai ( j ,x)wal(h,r) 


=  sign[sin2  x)^0+ho  n  (cos2n  x) 
k=l 


^+hk]  (16) 


When  j.  4  h.  the  term  ir.  the  product  expansion 
is  raised  to  the  first  power  and  remains.  When 
J.  =  h.  =  1  the  term  is  squared  and  is  always 
positive  so  that,  it  can  be  removed  from  the 
expansion.  This  operation  is  equivalent  to  the 
modulo  2  addition  of  J  and  h  so  that  the  product 
rule  is  demonstrated. 


Another  application  of  tne  results  present¬ 
ed  leads  to  a  Walsh  function  generator  similar 
to  the  one  proposed  by  Davies’  but  using  the 
subset  val(2k,x)  to  generate  the  Walsh  functions 
instead  of  the  subset  wal(2k+1-l,x)  (the 
Rademacher  functions).  Examination  of  (2)  shows 
that  the  Waish  functions  wal(2  ,x),  k=0,l,... 
can  be  represented  by 


wal(2°,x)  =  sign[sin2ux] ,  k  =  0 
val(2k,x)  -  sign(cos2k7ix)  ,k  4  0 


(17) 


This  set  of  functions  can  br  gt \erated  as  easily 
as  the  set  of  Rademacher  functions 

wal(2k+i-l  ,x)  =  ( x )  =  sign[sin2k+1Tix] .  (lo) 

The  individual  functions  used  to  generate  a 
particular  Walsh  func*  ios.  are  fount  iirectly 
from  the  binary  representation  of  the  index  J 
without  resorting  to  the  Gray  code  transforma¬ 
tion  of  j  as  in  Davies'  scheme.  Thus 

wal( j,x)  =  n  [wai(2k,x)]^k  (19) 

k=o 

The  advantage  of  using  (19)  is  not  significant 
when  zero  crossings  are  not  considered.,  i.e., 
when  Walsh  functions  are  generated  digitally. 
However,  when  the  continuous  Walsh  functions  are 
needed  in  analog  form  the  use  of  the  Rademacher 
functions  to  generate  them  presents  a  problem. 
This  problem  will  always  arise  when  any  product 
of  odd  Walsh  functions  is  used  to  generate  an 
even  Walsh  function.  The  odd  Walsh  functions 
have  zero  crossings  at  points  where  the  even 
functions  do  not.  This  is  evident  at  x=0  where 
all  the  odd  functions  have  a  zero  crossing  and 
the  even  functions  are  always  positive  one.  The 
set  (wal(2k,x)}  of  ( 19 )  generates  the  functions 
without  error. 


Conclusions 


,X  ;  ,1^  »v  ) 


(li>)  The  representation  of  the  Walsh  functions 

in  terms  of  the  sign  of  a  product  expansion  of 
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sines  and  cosines  provides  a  convenient  closed 
form  for  the  Walsh  functions.  Many  basic  prop¬ 
erties  of  the  functions  are  clearly  evident  from 
the  prod  t  expansion.  This  approach  also  sim¬ 
plifies  computation  of  the  Walsh  Junctions.  It 
was  shown  that  the  subset  of  Walsh  functions, 
wai(2k,x)-  can  be  easily  generated  and  used  to 
generate  the  complete  set  of  Walsh  functions 
without  zero  crossing  error. 
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Abstract 


Important  elements  in  dealing  with  linear 
control  systems  are  staLillty  and  performance 
and  there  are  many  methods  to  evaluate  these 
factors.  Nonlinear  systems  are  more  difficult 
to  handle.  Stability  can  be  looked  at  by  means 
of  analytical  methods  without  restrictions  on 
the  input  signal.  Performance  for  design 
purposes  can  be  handled  using  approximations  on 
the  input  signal. 

The  classical  method  to  study  nonlinear 
systems  for  system  design  is  the  describing 
function  method.  It  requires  that  the  form  of 
the  input  signal  to  derive  this  function 
approximates  the  actual  signal  at  the  nonline¬ 
arity  input.  This  input  signal  is  taken  to  be 
a  sinusoid. 

The  present  paper  studies  the  describing 
function  using  a  Walsh  function  input,  which 
may  take  the  form  of  a  single  function  up  to  a 
sum  of  several  inputs.  After  the  definition  of 
the  Walsh  describing  function,  some  fundamental 
remarks  are  give,  based  on  the  properties  of 
Walsh  functions.  Next,  particular  attention  is 
given  to  a  special  class  of  nonlinearities ; 
the  odd  nonlinearity,  after  which  a  general 
formula  is  set  up  for  a  finite  sum  describing 
f unction. 

Finally,  the  describing  function  is 
evaluated  for  a  set  of  common  nonlinearities, 
which  make3  it  useful  for  ready  computation. 

It  is  also  pointed  out  that  the  advantages  due 
to  Walsh  functions  disappear  for  nonlinearities 
with  memory,  because  of  the  multiple  valued 
definition. 

It  is  concluded  that  the  Walsh  describing 
functions  are  extremely  useful  in  the  study  of 
sylteus,  which  mainly  consist  of  nonline- 
arltles  especially  of  the  relay  type,  and  that 
its  very  nature  may  yield  a  better  means  for 
identification  cf  such  nonlinear  elements  for 
modelling  purposes. 

INTRODUCTION 


1.  Formulation  of  the  Describing  Function 
Method  lor  Zero-Memory  Non  Linearity  [1) 

Cumider  a  single  memoryless  nonlinear 
elements  of  the  following  form: 

y  -  £(x)  (1) 


Assuming  that  the  input  x(t)  is  of  a 
specific  fora  x  (t),  we  wish  to  seek  an  equiv¬ 
alent  set  of  gains  which  yields: 

ya(t)  -  NT(xa)x^(t)  (2) 

where  the  equivalent  gain  column  matrix  N  is 
chosen  such  as  to  minimize  the  mean-squared 
error  between  the  actual  cutput  f(x  )  and  the 
approximate  output  ya(t).  Thus  if,  with  fig.l: 

c(t>  *  f(xs)  -  NT(x8)xs  (3) 

then  N(x  )  is  to  be  chosen  such  as  to  minimize 
--s 

II  cf: 

|  c(t)  |  2  -  lim  /2t  |  e(ti  1 2dt  (4) 


2  T  T  2 

-  f  -  2N  X  f  +  (N  X  ) 

- s  -  -a' 

The  minimization  of  |c|^  with  respect  to  N,  can 
be  carried  out  by  setting  3 J c ) z / 3S  equal  Jto 
zero.  This  yields  J 

l  Nv  *  *  -  for  j-1,2,...  (5) 

k-1  *  8k  8j  8j 


Fig.  1  -  Block  Diagram  Representation  of  The 
Describing  Function  and  The  Output 
Error. 


2.  One  Input  -  One  Output 


For  this  case,  the  expression  (5)  becomes 


N  -  fx  / 
s 


(6) 


We  now  consider  x  to  be  a  Walsh  function  input, 
(notation  aa  in  8[2]) 


xg(t)-e*(k,t/T)  ;  k-0,1,2,...  (7) 


where  T  -  lnA  i 
definition  rime 


j  (or 


the  finite 


t 

! 

i 

i 


i 


In  order  Co  evaluate  N  from  (6) ,  we  have 
£x^“  (a/2nA)/^nf  [a$(k,  t/T) ]$(k,t/T)dt 

By  8ubscitulng  v-t/A  Che  laccer  formula 
becomes 

fcT  ■>  (a/2n)/2“f ia$(k, v2_n) ] $(k, v2_n)  dv. 

Buc  Che  function  $(k,  v2  n)  Is  constant  in  each 
Interval  n  <  v  <  u  +  1  where  u-0,1,2,...,  2n-l, 

_  2n-l 

fx  -  a2"n  l  f[a<>(k,u2_n)]*(k,u2-n).  (8) 

8  u  -0 

On  the  other  hand: 

2  .  2_-n,  r2a  ,2.,  --n.  , 

x8  -  (a  7  )  lQ  4>  (k,v2  )dv 

2n-l 

-  a22-n  £  *2(k,u2'n)  -  a2  (9) 

n  «  0 

Finally,  the  describing  function  (6) ,  for  a 
single  Walsh  function  Input,  is 

2n-l 

N(a)  -  (l/2na)  £  f [a*(k,u2  n) ] $(k,u2“n)  (10) 

u  -  0 


relatively  easy  with  and  without  a  computer 
because  the  discreteness  of  Walsh  functions: 

From  (10)  and  (12)  we  have 


N(a)  «  (l/2na)  £  f [awal(k,u) Jwal(U,u)  (14) 

■l-O 
and 

2n-l 

N ,(a,,...,a )  -  (l/2na  )  £  f[x . ar  ] 

1  A  1  u»  0  A  “ 

wal(k1,u)  (15) 

where  1  -  i,2,...,m 
n-1 

k  -  J  k,  2r  ;  k.  e{0, 1}  (16) 

1  r-0  * 

wal(kitu)  -  i>(k1,u2-n) 

and  [3]  waKk^u)  -  -1S  (17) 

n-1 

with  S  -  {k  ,un©  §  (k.  ©k.  „  .)u  ) 

i,n-l  0  ^  i,n-r  l,n-r-l  a 

where  ®  means  the  dyadic  sum  and  §  logical  sum. 

1.  Theorem  1  -  Sequency-independent  WIPF 


Later  we  will  show  that  the  second  member  of  ,  .  8ec°nd  ne3nber  of  (U)  18  independent 

(10)  is  independent  of  k.  of  k  *  °»  ^ 


3.  Multiple  Input  -  One  Output 

A  generalization  of  the  single  input  case 
is  one  where  we  may  have  a  combination  of  two 
or  more  inputs,  which  are  a  Walsh  function,  and 
where  one  observes  one  output. 

Let  the  input  be  x  of  the  period  T  (or 
defined  for  0  <  t  <  T) :  8 

where  x^  -  aA  $(k^,t/T) . 
kt  y  kj  (i  4  j) 
while  y  -  f(xx,  x2,  ....  x^) 

y  -  [N  N,  ...  N  )x  .  (11) 

8  1  /  m  -s 

We  remark  that  x^  and  x,  are  two  orthogonal 
functions,  x^x^  -  0  forJi  -  j,  and  from  (5) 

N^  -  x^f  /  x2  ;  i  ■»  1,2,...,  m  (12) 
The  mean-squared  error  is  so  equal  to 


S  o  ' 
l  Ni  * 
i-1 


2 

i  * 


(13) 


FUNDAMENTAL  REMARKS  FOR  COMPUTATION  OF 
WALSH  DESCRIBING  FUNCTIONS 


N(a)  -  (l/2a)  [f(a)  -  f(-a))  (18) 

Proof:  Consider  the  summation  in  (14). 
s  V  k  0,  we  have 

2n  term's  f(a)  corresponding  to  wa}(k,u)  -  1 
2  ana 

2n_  terms  (f(-a)  corresponding  to  wal(k,u)  — 1. 

So  the  suamatlon  is  Independent  of  k,  and 
(18)  is  evident.  QED. 

Remarks  JL: 

The  following  conclusions  can  be  drawn 
from  the  last  formula: 

Rl-l.No  computation  is  necessary  for  the  one 
input  case. 

Rl-2.Tf  f(x)  is  even,  N(a)  -  0  for  k  i  0 
Rl-3.If  f(x)  is  odd, 

N(a)  -  (l/a)f(a)  ,  (Id) 

and  particularly  for  this  case  the  approxima¬ 
tion  error  c  (3)  is  identically  zero.  This  is 
not  true  for  the  sinusoidal  DF. 

In  fact  from  (3)  and  (19)  we  get 

E  -  f[awal(k,u)]  -  f(a)  wsl(k,u) 

,f(a)  -  f(a)  ,  if  wal(k,u)  -  1 
”lf(-a)  +  f(a)  ,  if  wal(k,u)  -  -1 

Hence  e  -  0  (20) 


The  computation  of  the  Walsh  input 
describing  functions  (WIDF)  (10)  and/or  (12)  is 


Rl-4.N(a)  is  always  real. 
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Ri-5.  For  an  unbalanced  non  linearity  (18) 
gives  a  constant  error;  but  it  is  not 
difficult  to  get  this  bias  tern. 

2.  Theorem  2  -  Sequency  Independent  TWIDF 
(Two  W1DF) 


The  latter  formula  is  still  valid  if  one 
or  more  a^J^i)  arc  equal  to  zero. 

Note  that  N^(a^,ao),  independent  of  k]., ... , 
k^j  is  also  independent  of  the  3et  wal(k^,u) ; 
i“l . m<  n  . 


*If  the  zero-mean  input  is 

T 

x(u)  »  fajUallUj^u)  a.,wal(k2,u)  j  r  0 

(21) 

then  the  second  member  of  (IS)  Is  independent 
of  and  k2: 

Nl^al,a2)  “  4a~  tf (ai»V  +  f<ai-"a2)  "  £(-a1>a2) 
-f(-a1(-a2)]  (22) 

HjCaj.aj)  -  NL(a2,  a^  (23) 

*If  the  input  contains  a  DC  term,  i.e., 

*(u)  -  lajjWal(Otu)  a^aKkj.u)]1  ;  k2  4  0  (24) 

then  the  second  member  of  (15)  is  independent 
of  k^: 

N0(a0, ax)  -  (l/2a0)  [f  (a^)  +  f^.-a^  )  (25) 

Ni(ao*ai)'(1/2aiHf'ao*ai)  “  f<Val>'  <26> 

Proofs  Consider  the  summation  of  (15) . 

By  the  orthogonality  of  the  discrete 
functions  wal(k,,u)  and  val(k2,u)  it  is  clear 
that;  for  all  k.  i  0  and  for  all  k?  i  0  we 
have  J" 

2n  2  terms  corresponding  to 

wal(k.,u)  -  1  ,  wal(k-,u)  -  +  1 

1  ,  -  1 

-1  .  1 

-1  .  -  1 

Consequently, 

N2(ai,a.,)  -  (l/4a2)  (f  (aj  .  a2)  +  f  (-a^a^ 

-  f(-alt-a2)  -  f(alt-a2)J  (27) 

The  comparison  between  the  latter  expression 
and  (22)  yields  (23) . 

Renurkfi 

R2-1.  (18)  is  a  particular  case  of  (22)  with 
a2*  0.  On  the  other  hand  it  is  not 
difficult  to  generalize  (22) .  For  exempt, 
if  one  has  m  zero  mean  inputs  (a«;  n,  of 
course;  we  will  consider  the  case  m'n  In 
more  detail  in  section  4)  then: 

vai»--v  ■-»—  i  wV1  ar 

2  a.  r<*0 

3-1 . n 

...,(-l)rma]  (28) 

01 

where  i  “  1,2, .. . ,m <  n,  and  2n  is  the  period  of 
the  set  (val^.u)}. 


R2-2.  By  the  same  token  if  one  has  a  DC  term 
and  m  zero  mean  terms  (m<n);  one  gets: 

£(a0.(-i) 

0  j-l . B 

...,(-l)rmaJ  ,  (29) 

N1(a0....,ai).;i-  l  (V1  f[V(-l>\. 

2  a.  rj»0 

...,(-l)r%]  (30) 

wiie.re  i*  !,2,...,m<n  and  a  is  the  amplitude  of 
the  DC  term. 

Note  again  that  (29)  and  (30)  are  indepen¬ 
dent  oC  the  o"t  (wal(kifu);  i»  1,2, ...,m<  n). 

R2-3.  N^ta),  i“  0,1,-.  are  always  real. 

If  m  is  small  these  formulas  (28)(29)(30) 
are  handy  for  rapid  computation.  On  the  other 
hand,  for  large  values  of  m,  the  evaluation  is 
easy  with  a  computer  program. 

lINEARiZATION  SEPARABILITY 

For  this  section  we  will  consider  the 
input  x(u)  in  the  following  form: 
m 

x(u)  -  l  a  wal(k. ,u)  (31) 

i-1  1 

where  0  £  k,  <  k_  <  ...  <  k  and  a,  j*  0  for  i-*l,-.  m. 
i  m  i 

1.  Definition  1:  Strictly  Linearization 
Separability 

Let  the  input  be  (31) .  The  output 
y(u) *  f(x(u))  of  a  nonlinearity  is  called 
strictly  separable  of  order  a  if 
n 

y(x(u))  -  ys(u)  >  l  Ni(a1,_.,am)a1  wal^.u)  (32) 

1. e.,  e(u)uy(x(u))  -  yg(u)  »  0  for  all  u.  (33) 

2.  Theorem  3  -  Linearization  Separability 

of  Order  2 

*The  output  of  an  arbitrary  nonlinearity  is 
strictly  separable  into  DC  and  AC  Waleh  compo¬ 
nents,  i.e.  if  the  input  is 

x(u)  -  *0  +  SjWaKk.u),  k  i  0  (34) 


y(u)  -  aoN0(aora1)  +  a1N1(a0,a1)wal(k,u)  (35) 

*Any  odd  nonlinearity  is  strictly  sepa¬ 
rable  up  to  order  2.  i.e.  ra  •  1  and  m  »  2 


354 


PARALLEL  COMBINATION 


*Let  the  input  be  (34) .  From  (25)  and 
(26)  we  have  for  any  nonlinearity  (not  neces¬ 
sarily  odd) 

2aoHo{ao’ai>  -  f'W  + 

V 

JW  “  f(a0+al)  "  f(ao'al) 

•jxvO.u)  is  always  constant  and  equal  to  1. 

Thus  from  (36)  we  have  the  table  1. 

In  comparing  the  two  last  columns  we  see 
that  (u)  »  0, 

*We  have  shown  the  theorem  for  m  «  1  (see 
Rl-3) . 

For  m  »  2,  the  1st  part  of  this  theorem 
has  shown  the  separability  between  DC  and  AC 
Walsh  components.  Let  the  input  now  be 

x(u)  «  a1wal(ki,u)  +  a2wal(k2,u).  (37) 

The  nonlinearity  is  odd,  f(x)  «  f(-x).  Thus 
the  set  of  equations  (22)  and  (23)  must  be 
written  as 

2a1N1(a1<fi)  -  f(aj+  a2)  +  f(aj-  a2)  (38) 

23^2(32,^)  t^a^  a2)  +  f(ax+  a2) .  (39) 

f(x)  is  odd,  so  (39)  is  equal  to 

2a2N2^al’  V  “  f^al+  'V  “  f^al_a2)- 

From  (38)  and  (40)  consider  the  table  2. 
i.e.  e(u)  »  y(u)  -  yg(u)  “  0  QED 

Remarks 

R3-1.  The  separability  notion  Introduced  hare 
is  in  some  sense,  a  definition  of  the 
linearization  exactness.  The  output  of  a  non¬ 
linearity,  which  is  not  strictly  separable 
from  order  m  on,  gives  harmonic  components 
other  than  the  m  inputs.  For  exemple,  the 
sinusoidal  input  case  is  not  separable  for  the 
first  order  (except  the  linearity) ;  if 
f(x)  »  x^  and  x  “  sinuit  then  f(x)  *  (1/4) 

(3  sinot  -  sin3ut) ,  the  output  contains  a 
component  sin3wt. 

R3-2.  For  an  odd  nonlinearity  the  Walsh  descri¬ 
bing  method  is  not  strictly  separable,  in 
general,  from  the  order  3  on.  For  exemple,  if 
f(x)  “  x3  and  x  »  wal(kifu)  then  f(x) 

contains  a 


Consider  q  nonlinearities  f,,  f2,  ....  f 
in  parallel  such  that  the  output1  vfx)  is" 


y(x)  isM 


dlstorsion  term  waUk^  +  k2  +  k^.u)  . 

We  will  con:  Ider  the  case  in  more  detail  in 
section  4 , 


R3-3.  The  first  part  of  the  theorem  3  may  be 
important  for  the  study  of  unbalanced 
nonlinearity  cases. 

On  the  other  hand  the  linearization 
separability  of  Walsh  functions  input  suggests 
a  synthesis  of  a  group  of  nonlinearities  whose 
parallel,  as  well  as,  series  combinf  ion  has 
the  identical  input-output  characteristics. 


It  then  follows  that  the  WIDF  for  the  composite 
nonlinearity  is  given  by: 

N(a)  "  \  N,(a)  for  x  «  awal(k.u)  ,  (42) 

3-1  3 
and 

Na  W'V  ”  l  a  (al’a2} 
ai  1  2  j-1  j*ai  1  2 

for  x  -  f  a.wal(k. ,u)  (43) 

i-1  1  1 

where  N,  (a.,a7)  is  the  Walsh  DF  for  the 
th  1  1 

j —  nonlinearity  corresponding  to  the  input 
compcnnent  a^wa^k^.u) . 

SERIES  COMBINATION  [4] 

For  simplicity,  consider  2  nonlinearities 
f,,  f,  in  series  such  that  the  composite  output 
is 

y(x)-f2t(f1(x)] 

If  the  input  x(u)  is  x(u)  »  awal(k,u)  then 
the  output  z(u)  of  the  1st  nonlinearity  fj  is 
equal  to 

z(u)  -  f1Ix(u))  -  aN1(a)wal(k,u) .  (45) 

Let  z(u)  -  a  wal(k.u)  .  (46) 

z 

Then,  it  follows  that 
y(u)  -  f2[z(u)] 

-  azN2(»z)wal(k,u)  .  (47) 

From  (47),  (46)  and  (45)  the  KIDF  for  the 
composite  nonlinearity  is  given  by 

N(a)  -  agN2(az)/a 

*  aN1(a)N2(aN1(a))/a 

N(a)  -  N1(a)N2(eN1(a))  .  .48) 

If  the  Input  is  nos;  x(u)  -  ajwaKk^u)  + 

+  a2wal(k2,v)  then  in  a  similar  manner,  we  get 

ha  (a^ap  “  Nj  a  (a1(a2)S2  &  (a^  a  (ai’c2)' 

‘’“ufrV1  (49> 

for  i  -  1,2. 

This  results  (48)  and  (49)  could  be 
generalized  for  q  nonlinearities  in  series. 

Using  (42,48)  or  (42,49)  we  would  have  fc 
composite  parallel-series  combination. 
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TABLE  1 


wal(k,u) 

2aoNo(Vai} 

2a1N1(a0,a1)wal(k,u) 

ys(u) 

y(u) 

1 

f(a0+a1)+f(aQ-a1) 

f(a0+ai)-f(a0-a1) 

f(ao+ai) 

f(a0+ai> 

-1 

f(a0+al)+f(a0"al) 

-f(a0+a1)+i(aQ-a1) 

f(Val> 

£(a0-ai) 

TABLE  2 


wal(k^,u) 

wal(k2,u) 

2a1N1wal(k1,u) 

2a2N2wal(k2,u) 

ys 

y 

1 

1 

f(a1+a2)+f(a1-a2) 

f(a1+a2)-f(a1-a2) 

f(a2+a2) 

f<ai+a2) 

1 

-1 

f(a1+a2)+f(a1-a2) 

-f(a1+a2)+f(a1-a2) 

f(ax-a2) 

f<ara2) 

-1 

1 

-f(a1+a2)-f(a1-a2) 

f(a1+a2)-f(a1-a2) 

-f(a1-a2) 

£(-82+82) 

-1 

-1 

-f(a1+a2)-f(a1-a2) 

-f(a1+a2)+f(a1-a2) 

-f^+a^ 

f(-a1~a2) 

DESCRIBING  FUNCTION  FOR  FINITE-SUM 
ARBITRARY  INPUT  (AIDE) 

We  know  that  {wal(k,u) ;  k,u  -  0,l,..,2n-l} 
is  a  complete  orthogonal  function  set  [3],  and, 
in  general,  an  arbitrary  function  can  be 
expressed  as  a  sum  of  an  infinite  number  of 
Walsh  functions  [2], 

1.  Generality 

Consider  now  the  case  where  the  input 
x(u)  is  a  finite  sum: 

2n-l 

x(u)  "  l  \ wal(k,u)  (50) 

k*0 

where  all  a^  are  not  necessarily  different  from 
zero. 

The  reason  for  choosing  the  expression 
(50)  is  because  it  minimized  the  mean  squared 
error  Ix^u)  -  x(u)|2  when  ak  is  the  finite 
Walsh  Fourier  transformation  of  x^n(u)  .  x^  is 
an  arbitrary  input  and  P»?n  is  fixed.  This 
fact  is  well  known  and  may  be  illustrated  by 
the  figure  2.  Of  course,  the  bigger  P,  the 
smaller  the  mean-squared  error. 


Now  if  the  input  to  the  nonlinearity  is 
x(t)  (50)  then  the  approximate  output  is  y8(t), 
and  by  means  of  (11),  it  may  be  written  as 
P-1 

y  (“)  -  I  a.N k(a0,~,ap_1)wBl(k,u).  (51) 

k»0 

The  problem  is  still  finding  the  set 
N.(a0,...,a^  ,)  or,  precisely,  the  set 

\Nk(  V  •  *  *  '“P-l*  *  becauae 

if  some  a^  in  (50)  is  equal  to  zero,  writing  Nfe 
alone  is  then  meaningless. 

We  denote  that  the  number  m  of  zero  mean 
inputs  is  equal  torn*  2n-l>p.  So,  we  cannot 
apply  the  results  of  (29)  and  (30).  In  order 
to  avoid  this  difficulty,  consider  a  more 
general  formula: 

W  Wao . Vi>  (52) 

and  p_j_ 

f(u)  •  f(  l  a. wal(k,u)  (53) 

k-0  K 

Thus,  from  (15)  and  (50)  we  have 
P-1 

a^N^  -  (1/P)  l  f(u)wal(k,u) 


i[wal(k,0)  wal(k,l) ...  wal(k,P-))]  f(1) 

r  •  •  • 


f(0) 

fd) 

f(P-X) 


aoNo 

f(0) 

[aNJ- 

alNl 

-?*v  f!? 

“P-^P-l 

f(p-D 

where  [W^J  is  the  2  x2  Walsh  matrix. 

But,  in  matrix  notation,  (53)  means 


f(u)  -  f{[wal(0,u)  ...  wal(P-l,u)  ] 


Fig.  2  -  Finite  Walsh-Fourier 
Transform  Block 
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By  the  symmetry  of  Walsh  matrix,  so  let  us 
define 


[f{(Wp]  [a]}] 


£(0) 

f(l) 


|f(P-l) 

whore  [a]  -  [a^  ...  a^]1. 


(56) 

(57) 


Thus  (54)  becomes 

(aN(a0,...  .ap^] -(]/P)[Wp)[f{tWp][a]».  (58) 

2.  Linearization  Separability 

Theorem  4:  Closeness  of  Nonlinearity 
Output  Components 

*Let  the  input  be  (50)  a  Linear  combination 
of  a  complete  orthogonal  set  (wal(k,u) ;k,u  - 
1,...,P-1}  where  all  a.  are  not  necessarily 
different  from  zero.  The  output  of  any  zero- 
memory  nonlinearity  f(x)  may  be  written  as: 

P-1 

y[x(u) )  -  y3(u)  -  l  (a|cNic) wal(k,u)  (59) 

where  the  set  {(a^N^Jis  given  by  154)  or  (58). 

*Let  the  input  be  (50) .  If  »  0  for  k 
such  that  the  greatest  integer  part  ((k-t-l)/2] 
is  even,  and  if  f(x)  is  odd,  then 
P-l 

y[x(u)]  -  ys(u)  -  2  (a^^waKk.u) 


(60) 


k-0 

for  (k+l)/2  odd 

Equations  (59)  and  (60)  each  represent  P 
expressions  [u-0,1 . P-l). 

Pr£0_f:  *Let  the  column  matrix  (ya(u)]  be 
(y8(u)J  -  tys(0)  ...  y3(P-l))T  .  (61) 

from  (51)  and  (54),  it  then  follows  that 
[y8(u)]  -  [Wp)[aN] 

-  U/P)':.’p][wp]r«!Cu)) 

-  [f(u)J. 

*The  second  part  of  this  theorem  will 
be  shown  in  two  steps: 


(a)  Express  P-l 

x(u)  -  2  a^wal(k,u) 


(62) 


k-0 

where  (k+l)/2  is  odd 

in  a  linear  combination  of  Hadamard  (Walsh- 
Paley)  functions  ( j , u)  such  that 

P-l 

x(u)  -  l  b,h  (j,u)  (63) 

j— P/2  J  n 

n-1 

4  Jrur 

he, ,  (u)  *  (1-1)  r“°  and  (64) 

r.  j 

n~l  n-1 

J  "  l  )/  .  u  “  I  u2r  ;  j  ,U£(0,1)  (65) 


where  (3) 


r-0 


r-0 


(b)  From  (63)  apply  the  result  of  the  first 
part  of  the  theorem. 

Let  us  del'  following  bijection 

T  (one-to-cne  mam 


k  +  J  such  that  wal(k.u)  -  h  (j,u) 

r-i  n 


In  comparing  (17)  and  (64)  we  see  that 
F  !  j0  "  kr.-l  *  Jr 


and  the  inverse  T 


k  Qk 
n-r  n-r-1 
n-r-1 

kr  ‘  E  js 
j-0  8 


(66) 


(67) 


The  mapping  T  permutes  the  set  {a^;  k-0,..., 
P-l)  into  {bj ; j-0, .. . ,P-1) .  In  order  to  show 
(63),  from  (66),  it  is  thus  sufficient  to  show 
j-P/2,..,r>-l  or  jn_j-l. 

The  condition  [-j  (kfl/i*-2p+i, 

(p:positive  integer)  (68) 
may  b,-  written  as  follows: 


(69) 


^  m  j4r+l  for  k  odd 
4p+2  for  k  even 
But  k  -  0,l,2,...,2n-l,  so  (69)  gives 

p  -  0,1,2 . 2n-l,  i.e., 

n-3  n-1 

P  ”  l  Pr2  “  I  P.2  with  p  ,  ■  p  ,  >  C  (70) 
r-0  r-0  1  n  1 

Let  us  write 

p  -  (0,0, p, 


,n-3,pn-4,,“p0)' 

From  (69)  it  then  follows  that 

k-  {(pn-3*  Pn-4 . p0*°a)  for  k  odd 

(pn-3*  pn-4’,,,,p0,1,0)  f°r  k  even 

From  (67),  (72)  implies 


(71) 


(72) 


J 


n-1 


k0  +  kl 


1  ,  i.e. 


j  -  P/2,  (P/2)  +  1,  ....  P-l. 
(b)  In  matrix  notation,  (63)  means 


x(0) 

t 

0 

t 

t 

x(P/2-l) 

t 

» 

0 

x(P/2) 

f 

“p/2  j  ~“p/2  | 

kp/2 

T 

x(P-l) 

V* 

(73) 


where  Hp/2  is  the  (2n_1  x  211_1)  Hadamard 
matrix  [hn_1(j,u)).  Thus,  it  is  clear  that  for 
u-0,  1,  ...,  P/2-1 

P-l  F/2-a 

x(u)  -  l  b  h  (j,u)  -  l  bp/- 
j-P/2  j  n  j-0  P/2  J 


hn-i(j>u) 


and  for  u»P/2,  ...,  ?-l 
P/2-1 

x(u)  *  "  lQ  bF/2+jhn-l(j’u) 
i.e. , 

x(u  +  F/2)  -  -  x(u),  for  u  -  0,1, .., P/2-1  (74) 

Moreover,  the  nonlinearity  f(x)  is  supposed 
odd.  It  then  follows  that 

£[x(iri-P/2)  ]  »  -f  [x(u) ) ;  u-0, 1, . .  ,?/2-l  (75) 

The  approximate  output 
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p-i 

y„(u)  -  l  (u  )w»iu,u), 
*  it-o  *  *• 


R4-2.  The  theorem  4  may  yield  e  better  means 
for  ldentlilcatlon  and/or  syntheele  of  zero- 
memory  nonlinearity  elements. 


)  odd 


with  the  mapping  I'(k)  «  J,  becomes 
P-1 

y.(“)  “  l  (b .M,)h  (J ,u)  (76) 

•  J-P/2  J  J  n 


where  bjMj  - 

P-1 

"  (1/P)  l  f [x(u) ]wal(k,u) ;  from  (66) 
u-0 


P-1 

-  (1/P)  l  f[x(u)]h  (j,u);  from  (75) 
u-0  n 

P/2-1 

b.h.  -  (2/P)  I  f[x(u)]h  ,(J,u) 

J  J  u-0 

for  J  -  P/2 . P-1.  (77) 


From  (76)  It  la  not  difficult  to  see  that 
yg(u)  la  also  rotational  symmetric: 


y>(u  +  P/2)  -  -  yg(u);  u  -  0.1 . P/2-1  (78) 


Consider  then  u  from  0  to  P/2-1: 

In  matrix  notation 

lya(u)]  -  [Hp/2HbMl  (79) 

where  [bM],  from  (77),  Is  equal  to 

[bK]  -  (2/P)  Ilp/2l(f(u)]  (80) 

with  f(u)  •  f[x(u)]. 

Replacing  (80)  Into  (79)  results  In: 

[y8(u)l  “  [f(u)J.  QED 


Remarks 

R4-1.  The  theorem  4  explains  the  counter 
example  In  the  previous  section  (R3-2) ,  By 
caking  kj^-1,  k2“2,  kj-3  the  die  torsion  term  is 
6a^a2a^wal(0,u) . 

If  all  aii  Is  different  from  zero,  (59) 
means  that  the  output  of  any  zero-memory  non¬ 
linearity  Is  strictly  P-aeparable.  And 
particularly  the  output  of  odd  nonlinearity  is 
said  also  strictly  separable  for  odd  sequency 
components,  if  the  a^O  for  k  auch  that 
l(k+l)/2]  is  odd. 


For  example,  consider  2  nonllnuarities 
fl,  f 2  in  series  (44).  It  is  easy  to 
generalize  (49)  for  an  arbitrary  input  of  the 
form  (50) : 

The  composite  output  amplitude  of  the  k— 
Walsh  component  will  be 

*kNk(flo*  ",,aP-p  “  \Ni  k(“o . ®p_i) 

N2,k(80Nl,0 . “P-^I.P-I^ 

(81) 


CONCLUSION 


An  attempt  has  been  made  to  study  non- 
linearities  using  a  Walsh  function  input.  It 
has  been  established  that  the  resulting 
describing  function  is  always  a  real  function, 
and  that  it  is  separable  up  to  order  .wo, 

This  linearisation  separability  permits  the 
synthesis  of  a  group  of  nonlinearities  (series 
or  parallel  combination)  in  an  easy  fashion  by 
means  of  a  relatively  simple  closed  form 
expression.  An  arbitrary  input  can  be  handled 
in  a  similar  manner,  but  the  ma  lpulatlons  are 
more  complex. 
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APPLICATIONS  OF  WALSH  FUNCTIONS  TO  NUMBER  THEORY 

2.  Binkin  and  £.  L.  Hall 
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Abstract 


Results  are  presented  in  this  paper  of 
digital  pictorial  representations  of  various 
nunber  sequences  and  their  respective  Walsh 
transforms.  Fibonacci,  prime  nunwur,  and  si¬ 
mple  geometric  sequences  and  point  patterns 
are  generated  as  square  binary  arrays.  The 
array  elements  are  set  equal  to  1  if  the  sum 
of  its  coordinates  is  equal  to  a  nunber  in  the 
particular  sequence.  All  other  array  elements 
are  set  equal  to  0.  The  Walsh  transforms  are 
then  computed.  These  pictorial  representations 
reveal  certain  patterns  which  are  not  obvious 
without  the  pictorial  representations  and  the 
Walsh  transforms  of  the  arrays.  These  results 
indicate  a  method  in  which  digital  image  pro¬ 
cessing  methods  and  the  Walsh  transforms  may 
be  applied  to  describe  and  develop  patterns 
related  to  nunber  theory. 

Introduction 


The  use  of  pictures  to  study  nunber  theory 
is  not  new.  In  fact  over  2000  years  ago  Pytho- 
gorous  used  pictures  to  develop  certain  prop¬ 
erties.  For  example,  starting  with  a  single 
dot,  how  many  dots  can  be  added  to  form  a  tri¬ 
angle?  The  answer  shown  in  Fig.  1  leads  to  a 
s  imple  development  of  the  formula  for  the  sum 
of  ihe  first  n  consecutive  integers. 

?  i  -  n(n*D 
'  2 


Similarly,  starting  with  a  single  dot,  how 
many  dots  can  be  added  to  form  a  square?  This 
answer  is  shown  in  Fig.  2  and  again  leads  to  a 
formula  which  states 

n  , 

l  (2n-l)  =  n 
i=l 

that  the  sum  of  the  first  n  consecutive  odd  in¬ 
tegers  is  a  perfect  square. 

Manfred  Schroeder  [1]  expanded  on  this 
concept  of  using  pictures  to  study  nunber  theory 
by  using  computer  image  processing  techniques  to 
display  both  graphic  representations  of  nunber 
functions  and  their  Fourier  transform  in  order 
to  attempt  to  reveal  inte-esting  geometric 
patterns . 

In  this  paper  we  will  further  Schroeder' s 
work  by  graphically  displaying  various  nunber 
series  but  instead  of  computing  the  Fourier 
transform,  we  compute  the  sequency  ordered 
Walsh  transform  since  it  is  better  suited  for 


the  binary  functions  that  will  be  generated. 

The  series  that  were  investigated  were  simple 
point  patterns,  geometries  series,  Fibonacci 
series,  and  prime  number  series.  Each  one  was 
redefined  into  a  two-dimensional  function  and 
the  Walsh  transforms  were  then  generated. 

The  Seauency  Ordered  Walsh  Function 

The  Walsh  transform  [2]  is  being  used  in¬ 
creasingly  in  image  processing  [3], 

The  forward  Walsh  transform  is  given  by 

[4] 

N-l  N-l 

F(u,v)  =  l  l  f(x,y)  a(x,y,u,v) 
x=0  y=0 

where  a(x,y,u,v)  is  the  forward  transformation 
kernel.  For  our  use,  we  will  express  the  two 
dimensional  transform  in  matrix  notation.  For 
a  transform  kernel  that  is  separable  symmetric 
let 

'f]  =  image  matrix 

T]  =  transformed  image  matrix 

'A]  =  transform  matrix 

Then  by  matrix  multiplication 

[F]  =  [A]  [f]  [A] 

[A]  is  an  N  x  N  sequency  ordered  Walsh  matrix 

[5] .  An  example  of  a  4  x  4  Walsh  matrix  is 

‘l  1  1  1* 

w  =  1  i-i-i 

W  1-1-11 

.1  -1  1  -1. 

and  has  the  following  properties: 

1.  The  matrices  are  square  with  dimension 
2N  x  2N,  N  =  1,2,3,... 

2.  The  dot  product  of  any  two  rows  is 
zero. 

3.  W1  =  WT,  since  the  transform  uni¬ 
tary. 

4.  The  rows  are  ordered  by  increasing 
tne  number  of  sign  changes. 

Prime  Numbers 

A  4  x  4  array  can  repre.  ent  a  prme  number 
series  if  we  define  the  array  f(x,y)  as 
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1  if  N=x+4y  and  is  a  prime  number 
0  if  N=x+4y  and  is  a  non-prime 
number 

Fig.  3  is  a  pictorial  representation  of 
this  array.  Fig.  4  shows  how  the  sequency 
ordered  Walsh  is  calculated.  Fig.  5  and  6 
show  digitally  processed  images  of  both  the 
original  image  and  its  Walsh  transform.  In 
order  to  implement  the  ordered  Walsh  transform 
with  differently  sized  arrays,  the  n  x  n  array 
will  expand  out  to  a  128  x  128  array  by  addi¬ 
tion  of  zeros  (see  Fig.  7).  This  128  x  128 
expanded  matrix  was  operated  on  by  a  128  x  128 
ordered  Walsh  matrix  to  generate  the  Walsh 
transforms. 

In  prime  number  arrays  of  size  (N  x  N), 
when  N  equals  non-prime  numbers,  vertical  bands 
tend  to  stand  out  as  in  the  cases  where  N  =  30, 
40  and  4.2,  shown  in  Figs.  8-10.  When  N  equals 
a  prime  number,  diagonal  bands  become  more 
apparent  as  with  N  =  31,43,  ;.hown  in  Figs.  11 
and  12. 

The  Walsh  transforms  of  these  (N  x  N) 
prime  number  arrays  fall  into  one  of  two  cate¬ 
gories,  either  high  contrast  and  low  contrasted 
array  elements;  no  pattern  is  apparent  between 
the  category  of  the  Walsh  transform  a^d  the 
value  of  N,  but  many  of  these  transform  arrays 
have  some  interesting  patterns  that  can  most 
effectively  be  observed  when  displayed  graph¬ 
ically  as  in  Figs.  13-20. 

Points  Patterns  and  Line  Patterns 


transform  when  N  equals  a  binary  number  as 
compared  to  Walsh  transforms  when  N  equals  a 
non-binary  number.  If  the  array  is  a  point 
pattern,  N  >  1  and  M  >  1 ,  the  Walsh  transform 
appears  to  be  equal  f(u,v)  =  g(u,l)  x  h(l,v), 
where  g(x,y)  is  the  Walsh  transform  of  a  set 
of  vertical  lines  and  h(x,y)  is  the  Walsh 
transform  of  horizontal  lines.  Figs.  33  and 
34  illustrate  this  with  a  point  pattern  array 
where  N  =  4  and  M  =  3  and  its  Walsh  function. 


Power  Series 

Another  interesting  set  of  series  to  study 
with  image  analysis  is  the  power  series.  The 
two  dimensional  array  can  be  defined  as 

1  when  x  +  (128y.y)  =  P1  where  P 
fix  vl  =  equals  an  arbitrary  constant  and 
I  equals  any  integer. 

0  for  all  others 

In  these  arrays  there  are  no  evident  patterns 
except  in  the  cases  where  128  is  a  multiple  of 
P.  n  this  case,  the  first  row  and  the  last 
column  f  each  array  are  equal  and  all  other 
elemen.;.  of  the  array  are  equal  to  zero. 

I  he  Walsh  transform  of  the  power  series 
•  have  similar  characteristics  between  them. 

They  all  tend  to  have  vertical  bands  of  differ¬ 
ing  textures.  When  I  is  odd,  there  is  definite 
oscillating  in  the  texture.  When  I  equals  an 
even  number,  the  texture  tends  to  be  more  even. 
Figs.  35-38  are  illustrations  of  array  repre¬ 
sentations  of  the  power  series  for  I  =  2  and  3 
and  these  Walsh  transforms.  As  P  becomes 
larger,  th°  vertical  bands  become  more  obscure. 


The  sequency  ordered  Walsh  transform  of 
point  and  line  patterns  with  definite  geometric 
patterns  also  contain  definite  geometric 
patterns.  To  illustrate  this,  128  x  128  arrays 
were  generated  where 

1  when  x  =  iN 
y  =  jM 

where  i,j  =  1,2,... 

0  for  all  others 

For  each  of  these  arrays,  the  Walsh  transforms 
were  calculated. 

It  becomes  obvious  that  the  Walsh  trans¬ 
form  of  point  patterns  with  any  x  and  y  fre¬ 
quencies  can  be  defined  in  terms  of  the  super¬ 
position  of  the  Walsh  transform  of  vertical 
lines  of  S  frequency  and  horizontal  lines  of 
M  frequency. 

The  Walsh  transform  of  e  set  of  lines 
is  an  array  of  all  zeros  ex cep „  in  the  first 
row  or  column  perpendicular  to  the  set  of 
lines.  Examples  of  sets  of  line  patterns 
with  M  =  1  and  N  =  1-5  and  their  Walsh  trans¬ 
forms  are  shown  in  Figs.  21-30.  By  rotating 
the  set  of  lines  bv  90°  the  Walsh  transform  is 
rotated  also  by  90°  as  illustrated  in  Figs. 
31-32.  Notice  the  simple  patterns  of  the  Walsh 


Fibonacci  Series 

Th°  Fibonacci  series  is  generated  by  the 
fo.mul,  r(N)  =  F(N-l)  +  F(N-2)  where  F(l)  =  1 
and  F(2)  =  2.  This  can  be  put  .  ito  a  two 
dimensional  array  by  setting  I  =  X  i  128y  and 

ff*  v/l  jl»  when  *  a  Fibonacci  number 

Tix.y;  -  otherwise 

This  array  is  pictured  in  Fig.  39  and  its  Walsh 
transform  is  pictured  in  Fig.  40. 

Conclusion 

In  this  paper  we  have  considered  various 
number  series.  Each  series  was  redefined  into 
a  two  dimension  array  and  the  ordered  Walsh 
transform  was  computed.  The  hope  was  to  find 
geometric  patterns  in  either  tne  two  dimension¬ 
al  array  representation  or  their  Walsh  trans¬ 
forms.  In  the  case  of  point  patterns  definite 

patterns  were  found.  In  the  other  cases  defin¬ 
ite  patterns  were  obscured  yet  some  general 
patterns  were  still  discovered.  Further  work 
in  this  area  could  possibly  prove  to  yield 
some  interesting  discoveries  in  number  theory 
and  if  nothing  else  would  improve  one's  intui¬ 
tive  feel  for  the  Walsh  transform  and  its  appli¬ 
cations  with  respect  to  pattern  recognition. 
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Fig.  1.  Triangular  numbers 
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i=l 


Fig.  2.  Rectangular  numbers 


F ig.  3.  Prime  numbers  indicated  on  a  4  x  4 
array 
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Fig.  16.  Walsh  transform  of  Fig.  15 


Fig.  19.  42  x  42  array  of  prime  numbers 


Fig.  18.  Walsh  transform  of  Fig.  17 


Fig.  21.  Point  pattern  N  ■  1  and  M  =  1 


Fig.  22.  Walsh  transform  of  Fig.  21 


-  Fig.  25.  Point  pattern  h  =  3  and  M  =  1 


Fig.  24.  Walsh  transform  of  Fig.  23 


Fig.  27.  Point  pattern  N  *  4  and  M  *  1 
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Fig.  28.  Walsh  transform  of  Fig.  27' 
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Fig.  31.  Point  pattern  N  *  1,  H  ■  2 
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Fig.  29.  Point  pattern  N  =  5  and  M  =  1 


Waish  transform  of  Fig.  31 
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Fig.  30.  Walsh  transform  of  Fig.  29 


rig.  33.  Point  pattern  N  *  4  and  H  *  3 
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Fig.  36.  Slalsh  transform  of  Fig.  35 
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Measures  to  chqract arl ze  randomness 
In  finite  binary  sequences  have  been 
pronosed  by  various  authors.  ftnongst 
these  ere  the  one's  obtained  through  the 
computational  complexity  approach  and 
the  Integral  transform  approach.  The 
latter  measure  which  Is  given  by  the 
ratio  of  the  number  of  non-zero  ',ralsh 
coefficients  of  the  sequerce  to  its 
length,  Is  unambiguous  and  readily  cal¬ 
culated.  Further  this  procedure  seems  to 
give  results  similar  to  those  obtained 
through  the  comput at ional  complexity 
approach.  This  paper  1  s  an  attempt  at 
explaining  the  efficacy  of  the  Walsh 
transform  measure. 

The  resu]t  on  the  rum  her  of  long 
random  binary  sequences  is  further  ana¬ 
lyzed.  The  measure  is  also  generalized 
to  cover  other  transforms.  This  is  ill¬ 
ustrated  using  discrete  Legendre  trans¬ 
formation.  It  is  shown  that  for  this  the 
procedure  becomes  cumbersome  «nd  the 
results  less  amenable  to  meaningful 
Interpretation. 


Recently  there  hps  been  a  consider¬ 
able  interest  in  the  computational  - 
complexity  approach  to  the  definition 
of  a  finite  random  sequence  pioneered 
by  Solomonoff  tlj  Kolmogorov  [2]  ,  [2] 
and  Chaitin[4]  ,  [5]  .  Instead  of  testi¬ 
ng  a  given  sequence  for  regularity 
through  sub-sequence  generation,  the 
approach  involves  directly  asking  if 
the  sequence  is  irregular  or  complex. 
The  notion  of  complexity  is  taker  to 
correspond  to  the  length  of  the  short¬ 
est  urogram  capable  of  generating  the 
sequerce  on  a  certain  asymptotically 
optimal  machire.  On  the  basis  of  this 
definition  those  elements  of  a  finite 
population  whose  complexity  is  maximal 
•»re  called  random.  It  has  been  shown 
that  most  sequences  in  »  population  «re 
random.  Per  Mertln-LOf  [f]  has  also 
shown  th»t  the  above  definition  leads 
to  all  conceivable  statistical  proper¬ 
ties  of  randomness.  For  infinite  random 
binary  sequences,  the  ron-rardcro  seq¬ 
uences  h»ve  been  sho^r  to  form  a  maxi¬ 
mal  cor  struct! ve  null.  set.  Fine  [7]  has 
elaborated  these  conclusions  for  finite 


seouorcos.  ’pparopt  co^'ver'rerce  or  the 
relative  frequency  Is  °ho'n  to  occur, 
because  or  and  not  In  sMte  or ,  the 

v’lgh  Irregularity  (or  pan  'ornreeal  or  tw> 

data  seouence,  'fyrther  ♦  he  stability  v* 
reiativR  frequency  in  've  to  the  apr_ 
ao-ch  to  data  "nd  not  according  to  some 
law  .of  nature.  Consequent  a  v  it  ''nra^rr 
that  ap p - y» ent  stability  In  f-ecuerev 
cannot  he  used  ror  ext p"rol -t ion  of 
future  data, 

'nother  approach  which  Vy?  ''sen 
employed  in  the  representation  or  finite 
binary  seqv areas  \ipes  orthornqnal  fvn- 
ctlons  [8]  ,  [”9]  .  Tbis  verv  straight¬ 

forward  procedure  involves  the  -"enre- 
sentation  of  the  given  sequence  In  a 
weighted  sun  of  W3I3V1  functions.  The 
number  of  such  term 3  require'  per 
sentience  digit  is  then  a  measure  or  the 
rnrdomness  of  the  sequence.  This  app¬ 
roach  seems  to  vl el d  results  much  simi¬ 
lar  to  the  comput. at.inr-compT  ext ty  err. 
aonch.  The  Walsh  function  expansion 
procedure  also  leaas  to  the  result  thrt 
most  sequences  ar©  random  *nd  therefore 
seems  to  suggest  the  s*me  conclusions 
as  listed  in  the  rrece-’lne  paragraph. 

Investl pat  1  r g  the  aupa-ert  similar¬ 
ities  of  the  two  approaches  seems  to  i-e 
a  worthwhile  prowls.  The  eonavt»tior 
complexity  anrroacb  hop  its  roots  ip  tbe 
work  of  Church  [lr]  who  used  the  cor  cent 
of  effective  conrutabi? 1  tv  to  define 
infinite  random  sequences,  ^V'ever  Ibis 
definition  turns  out  to  different 
from  that  obtained  in  the  former,  helrg 
infact,  only  a  clarification  or  the 
notion  of  the  kollektiv  of  von  Mise9 
111]  .  The  kollektiv  1  s  an  infinitely 
long  random  sequence  Ip  which  limits  of 
re]  ntl  ve  frequenci  es  exist  op*  there  is 
no  scheme  o'  predicting  outcome  x^  of 

tri  al  r  given  knowledge  of  x, ,  . . 

Fp-1  1  that  vields  ipfirlte  .  obsftouerces 
having  relative  frequencies  that  differ 
from  those  of  the  original  sequence.  rte 
idea  of  subsequence  generation  'ms  »]«o 
taken  up  by  K«rl  ropner  vSo  however 
felt  th«t  a  more  satisfactory  approach 
to  tbe  definition  of  op,  infinite  random 
sequence  should  bo  *  generalization  c* 
a  random  finite  sequenoe.  Tr*  a  loose 
fashion,  the  authors  approach  (?)  cf 
reurenerting  the  pivon  sequence  through 
a  Walsh  function  aTprnsion  fror.- 
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the  not i ort  o'  arh-soovenoe  ger'  vot^or. 
It  -'Iso  draws  'ron  the  enroot  ft  tor  com¬ 
plexity  appro"'’’'  in  beirg  ar  attempt 
at  conw’psslng  data  (cr  dimsr.sion  con- 
ti'"oUrr' 

ta  import  art  quest  lor  tVt  arises 
r.c  v  is  whv  s^ul  a  the  Welsh  transform¬ 
ation  be  c^s^n  for  aimursion  contract— 
■•or  In  r> reference  to  other  vrarsPorms. 
i  he  ’■'•■•Ish  funcaionc  corr'’s,.i''rd  to  only 
one  o,-t  of  r-  pre^t  many  possible  vector 

bases  ?or  2*  -  dimensional  su-ce  ^rd 
each  hast?  wouM  yielo  a  di'ferent 
measure  of  rn  donna ss  as  n  general  i  act¬ 
ion  ef  this  measure.  lhere''o~e  ?  rat¬ 
ion -le  must  be  fount}  'or  the  efficacv 
of  ’*0  so  functions,  or  this  measure 
5arer"11?M  ip  some  manner  to  irdvde 
all  hoses.  In  our  view  the  former  app¬ 
ears  more  'Mhelv.  In  this  paper  °r  att¬ 
empt  h»s  be"n  made  to  iusttfv  this 
belief.  <an  instance,  where  the  measure 
of  randomness  using  ’’el  sh  transforms 
is  extended  to  inc'ude  discrete  Iesen- 
dre  transforms  is  »]  so  st”died.  It  i  s 
sWo'-n  how  the  end '’sis  hecomes  involved 
for  tht s  case. 


I -ea sure  Vslr.R  Wal  sh  fransfom 

let  v^(i)  represent  the  kth  dis¬ 
crete  ”oish  Pnnctior  of  t,  where  k  °rd 
t  are  non-novafive  integers  smaller 

than  r  =  2n  .  ril so  let 

<«a,cm.l  =  (Vl  k„-2--kol,„.„ 


decimal  “  '  Wi-l  kn-2**.k0^ 

°biraiy 

then  the  Walsh  function  set  Ls  defined 
throueh 

5^  g<  (k)tj 

=  (-1)  1=0  (1) 


gn-i(V'  =  V  vc 


In  ’-'Wat  Oo1’’o'’s  r^e  uf1jti  P|'rct- 
iprs  ,i'a,r  be  used  either  ir  rhe  natv_,"l 
oaaortnn  or  tve  som-orcy  pr-'orlnn, 

1  he"e'ore  '■-»  -won’  d  not  r~*  "'Vronti»t“ 
between  them  and  rpPop  to  either  pe 
then  aS  w  (t> 
k 

"or  s(t),  an  orMtr-rv  *"ovnded 
furctior  op  tve  discrete  par-moter  t, 

(t  =  0 , 1 ,  . . .  ,  2P— 1)  ,  the  ’’-IcVi  t  rans-Vlf 
s  (k)  i  s  den  r  ed  Vv 


*  ~r- 

s  (k)  =  r  . 


vj,(t)  s(t)  (<) 


7ho  lovarse  trer  pCf-rrii afl  or  1  P  -ommiP- 
tricnl  • 

-4-  * 

s(t)  •-  r  21  w  (t)  s'l-)  (*) 

k  V 

Giver  a  hirarv  seoueree  s(t).  ’>e  **  rst 
find  its  ”a?  sh  trarsPorm  s^ft; 
then  obtain  another  sD|p'“rce  *’g(v) 
throurh  the  Pollo’-irq  n-ocadura; 


u  (k>  = 


(1  if  s*(v)  /  o 
1o  if  s*(k)  =  f 


Then  the  measure  oP  pa+tern  nwf.) 
pP  the  sequence  s(t)  is  doftped  by* 

*  (s)=  "i-v‘“XZlv  (v)  TO'  (7) 

k  s 

where  I(k)  is  =  !’  units  lpr>e 
o'  +Ts. 

rnvie  rapdpmness  measure  rr(,)is: 

rw(s)  =  i  .  pw(s) 

=  V'1  2Iu  rV)  j(k)  (?) 
k  s 


I’or  i’<vr  -1  ordered  Walsh  functions 

=  kA  (?) 

Hhil„-  Por  soqrency  ordered  funct-'ors, 
g^(k)  *  s  arc  dpftr.ed  through  the 

follc'i'irs  relations; 

Mk)  =  "r.-l 
hU)  T  Vi  +  kn-2 


eo(k)  =  k  +  k 

n-2  r_3 


This  dePinition  is  the  came  »s 
given  in  [8]  ,  except  that  the  measure 
has  beer  defined  using  the  discrete 
transform,  where-s  it  h®d  been  done 
iihere  through  the  »r>aloe  Walsh  trans¬ 
form  of  n  stepped  wsvePonn  corres¬ 
ponding  to  the  binsrv  sequence. 

If  s(t)  Isa  (1  ,r)  seouence,  the 
number  of  non-xero  usrk)  would  for 

cert ai)  sequences  he  large,*  by  one 
compared  to  «hen  s(t)  is  a  (i,-i) 
sequence.  This  is  because  trnrsfir- 
mation  through  ^(t)  rives  the  rver-aqe 
value  of  the  sequense.  ^rther  the 
ntBrtbei'  of  Independent  values  the 
tranaloioed  sequences  sould  he  less 
if  s(l)  is  corr.l-iered  a  Ov-i)  series. 


?or  exnmrle  the  '>’alsh  transform  of  1  1 
l"f'Cllis6f  -2  0  2  r  2  0  while 
that  of  1  111  .]  4U1s  4  r  .4  C  4 
f  4  C 

We  rgw  ^  scusa  the  result,  river  as 
theorem  In  03  •  it  ”es  claimed  tvat 
for  sequences  of  lergth  2^  ,  the  ore's 

voth  r(s)  <  2-kv  p^e  less  than  ??  Ir 
rvraber.  ”ere  v  oar  also  renrasert  the 
number  of  ro^-raro  b'alsh  components  of 
the  seovercc.  THs,»s  ”as  pointed  out, 
also  mears  that  most  seoverces  of  length 

2^  have  the  randomness  measure  close  to 
unity.  It  will  ';o  shown  that  fheorer,  3 
of  (?3  is  valid  orlv  in  a  rough  '■ ny . 
Ibis  is  because  lirra^  of  [P]  Is  stric¬ 
tly  true  for  a  certain  class  of  seque¬ 
nces  orl-',  and  because  for  a  finite 
rorvlation  only  a  finite  rumber  of 
values  of  r(  s)  wil1  be  attained. 

The  total  rummer  of  seoverces  of 

length  2^  is  2r  .  I  ®t  the  number  of 
(1,C)  seoverces  T.dtb  1  zeros  he  n., 

Ihen  .  .  J 


...  (*) 
i  \  i  / 


It  car  also  be  shown  easily  thot  for 
i  odd,  the  rardotf.ress  m“"sure  is  a’v'ays 
vritv.  Cr  the  rximber  of  seoverces  with 
rf  s'  =1  is 


i  odd 


i  odd 


“1,3,5,  Vi/ 


laere^ore  exactly  one  half  of  the  rorv- 
latior  ot  sequences  of  a  certain  length 
is  completely  rardom.  “owv  =  w  -1 
elves  vs  the  number  of  seoue^ces  that 
are  rot  ely  random  ~rd  t^is  oo- 

\-«is  :  Theorem  of  [P]  ,  'Wch 

agrees  with  ovr  resv.lt.  !’ evert heless 
for  other  values  of  v  there  mi  pht  he 
some  variation  from  tha  bovrd  2V.  Thus 
for  v  =  2,  the  theorem  gives  \he  rum her 
of  such  sequences  »?  4.  "ovever,  sveh 
sequences  vovld  he  at  least  if  in  ronb- 
er,  being  the  wolsh  functions  of  that 
length.  To  sun  vn  exactly  half  the 
sequences  ore  comnl etely  rardom,  and 
morn  seq\  erces  than  given  hy  Theorem  9 
of  [i\  hove  r(0  Cose  to  zero.  The 
co1' cl ’'s* or  that  most  of  the  seoverces 
have  t  ♦hji  r  rardonress  measure  Cose  to 
VoCtv,  ho"evar,  bolds. 


The  reason  for  the  er‘'<cacv  p4*  the 
vCsh  trarsfonn  In  the  ch»racte^< nation 
o4"  firite  hinarv  seoverces  stems  from 
*”«  '‘Cowing.  The  set  o4'  all  hjraw 
seqverces  of  lergth  oV  eorns  ,r  -tnr 
groun  with  a/»dlHcr  nr.ari0  o  as  the 
eroun  operation.  The  patvaoi  hap-tj  '*or 

a  2k  -  J1a;ers1rirn1  vector  Srafie  covr- 

esnordir?  to  this  erov"  Is  the  set  of 
"alsh  4'un ot i on s :  sh  Unctions  no-'  he 

"’eCve-*  4'rcm  the  cha-aaro,.  pppup  the 
dvad-'c  eroun.  J  he  re  Of.  ae  rrafewce  '“or 
’•’alsh  'Yrctions  4n  '’e^rine  a  var-'orn- 
ness  meajT”e  seems  Misfired.  rhe  number 
o41  ror-zoro  bsj  ph  coa'ronvnts  civpa  t'ae 
number  of  "ideations  in  this  cornel  pats 
system  In  wv,{Ch  iv.,*  ceoveroe  has  erm- 
nonerts.  Vrom  the  to-oloev  0  pb  _ 
dimers! oral  space  It  cap  he  deduced  that 
most  points  on  a  i'  -  -Mmersloral 
'^■111  not  He  at  the  er-ba  o*'  the  haSis 
veotors. 

■t-Cgendre  Trans -Vi-nm  Chora, .tori  ?at< pp 

The  5iso-ete  Iefen'’re  transform  hP] 
is  one  of  the  mapv  -m  sorete  orthogonal 
sequences  sets.  It  has  heeo  slneled 
out  for  discussior  sir ce,  unliVe  some 
other  orthoSoral  sets,  it  has  not  hoer 
often  use’  for  the  classification  of 
sentences.  It  aiPr,  v,,3  *he  advantage  o4" 
orthogoralltv  over  »rv  number  of  rCnta. 

f  discrete  Ieeen-’re  r'ol,'rnomi »1  set 

(t,L)^  o4*  length  L  ap-s  degree  i 

vltb  t  ?>s  the  por^n (t  =  r  7 

1-1)  1  S  dpSjpgjl  V,v;  ’ 


di(t’T)  -5 ( 


^  (vi 

where  t  is  the  so-called  heebvar-5 
factorial  function  of  order  b*. 

(V) 

t  £  t(t-’ ) . . .  ( t  — b  +a  1  (v> 

=nd  0  is  the  binomial  coefficient 
deftped  hy; 
f*\  x! 

(  .  !  = -  (l/i 

V.1/  .1!  ( x— 1 )! 

The  follo’-ing  morerti  es  cap  row 
be  easily  verified; 


dj(t,l)  d  (t,I)  =  r  ,1/  .t 


di)  W— 


t  =  c 


[«*, 


(2i+i)(t.i) 


-(1)  *  «i 
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and 


besLS^ 


<41i)  21  f(t’k)  di(1>L)=C  , 

to 

C  4  k  <  i 

where  f(t;k)  is  anv  polynomial  of  degree 

k. 

iny  sequence  s(t),  of  length  1,  can 
be  written  in  terais  of  the  discrete 
Legendre  polynomials: 

s(t)  =  ^  y(i)  d  (t,l)  ( 15/ 

1=0 

Multiplying  both  sides  by  d  (t,L) 
and  summing  over  t  after  charging  the 
order  of  summation,  we  obtain: 

y(!)  =  ^  s(t)  d<  (t$l)  <16) 

t=0 

The  sequence  y(j)  Is  called  the  discre¬ 
te  Legendre  transform  of  the  sequence 

S  \  X  )  « 

The  transformation  mav  be  done 
directly,  or  othervd  so  a  Legendre  matrix 
may  be  constructed  first,  which  operat¬ 
ing  on  the  giver  seouerce,  elves  the 
Legendre  transformed  sequence.  The 
Iegardre  matrix  may  be  written  dovr.  usi¬ 
ng  the  definition  (12).  For  L  =  8,  we 
thus  obtain  an  8th  order  matrix,  which 


1  5/7  3/7  1  /7  -1/7  -3/7  -  5/7  - 1 

1  -i-  zl  -.5.  -_5.  -_2_  .1  l 

777777 

1  *4  -1  +  f  1  |  -i 

1  j  9  9  -3  -B 

7  7  7  7'  7  7 

-23  17  is  -15  -17  23 

7  7  ~7  777 

1  -5  9  -5  -5  9  -5  1 

1  -7  21  -35  35  -  21  7  -1 

with  M  as  :  8,  24/7,  24/7,  264/49,88/7, 
312/7, 1 264, 3432.  ’  ’ 

ts  an  example  t*e  Legendre  transfor¬ 
med  sequence  of 


4  8/7  12/7  i?  ^  £  €  74 

7  7  7 

Kov  pattern  c)  aSsi  '’ication  nsine 


“V *L Z  noivromials  consists 

O'  the  following:  Ohtadr  the  I,ep°rfirf> 
transformed  sequence  v'l).  n^ytej 
v  (1)  as  given  below:  / 


fa  .  r(>y  .  , 


1  ’  -nyr  <  1/k  / 

v.rhere  k  is  an  afe}v  chosten 

corstart.  Thus  V  could  he  t„Vgr,  /*s 

»  t0T*  *  'rher  ^be  ’”’f:,omness/rreapvpe 
vJa  the  Legendre  transform,  ^(i)  is 


vcO)  If?)  08) 


^(s)  =  I-1 


JO)  is  ri  I  unit  long  sequence/  of  +i*s# 
f  s51?1,  }.}  L  0  r  r  0  7..  '"or  /instance, 

St  ”r"',!(,'or  *?’ 

The  nrocedure  using  Legendre 
transform  is  avite  cumbersome  compared 

we  ^!+0Pe  ’■t,lsb  tran'sfoim,  since 

•e  must  each  time  commute  the  Ieeerdre 
matrix  afpesh,  which  additionally  is 
only  orthogonal  and  not  onthonorm al . 

rrrf-e  11e*  tr  its  app¬ 
licability  without  constraint  or  the 
sequence  length,  whereas  '’or  the  Pro¬ 
cedure  using  i-’alsh  transforms  the  l»neth 
L  must  be  of  the  form  2^. 

In  (17)  vg(s)  h— s  been  considered 
zero  for  normalized  v(j)  <  i./k  (k  suit- 

ably  lai.Ke)  Slrce  anr  v^lues  t>,ere 

horefujly  *e  no  problem  in  f'xirg 

the  origin*)!  sequence  correctly  or 
.  irverse  Iegerdre  rraps'’opm~tion. 

The  Ieeendre  transform  charocte?_ 

o'1wS!.  =  Vln,,rv  sequences  gives  most 
o.  than  aS  being  car,r7etelv  random, 
however,  except  for  the  sequence  of 
+!• s,  no  other  binary  sequence  would 
correspond  to  anv  0f  the  h-,Sis  vectors 
of  the  space  sparred  bv  the  Legendre 

randomness  measure 
f*  funct ion  of  the  constant.  V,  whose 
choice  to  y  great  extent  is  arbitr-rv. 

therefore  interr-etaticn  of  meosi-re 

.ed  tbrough  this  transform  is  more 
difficult  than  through  '-'nis>i  transform. 

Cor  cl  v  si  pu  s 

Jn,,TMs  ^®r  is  an  extension  of  the 
work  reported  earlier  bv  the  author  (8) 
on  class' fi cati or  of  binarv  sequences, 
an  attempt  has  been  made  to  show  the 
superiority  of  the  method  employing 
■■alsh  transforms  to  other  techniques  of 

^IrPs4(/fc^nr*  *°  0  '3e?fee  the  treasure 
us,r.g  'ajah  transforms  arrears  to  give 
results  similar  to  the  computation  - 
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complexity  approach.  Since  the  ccrauut- 
»t  Ion -complexity  am  roach,  further,  is 
based  on  the  information  cont ert  of  a 
sequence,  our  measure  also  lends  itself 
to  a  similar  interpretation. 
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OF  MATRICES  WITH  WALSU  ITFCTIOFS  up  THE  EIGENVECTORS 
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B* cl rciilant  Matrices 


The  properties  of  Hadsmard  and 
related  matrices  like  circulant  and 
back-circulant  matrices  have  been  stud¬ 
ied  extensively.  This  paper  presents  a 
new  relative  of  the  back-circulant 
matrix,  called  the  bi circulant  matrix, 
and  discusses  its  prooertles.  Ihe  eigen¬ 
vectors  of  the  bici rciilant  matrix  have 
been  shown  to  be  the  discrete  Walsh 
functions.  The  eigenvalues  are  obtained 
by  finding  the  scalar  product  of  any 
row  of  the  bicirculant  matrix  with  the 
various  Walsh  functions.  Some  particular 
bicirculant  matrices  have  also  been 
analyzed.  among  these  is  a  stochastic 
m°trix  which  could  have  applications  to 
statistics.  The  importance  of  bicircu¬ 
lant  matrices  to  the  regular  represent¬ 
ations  of  abstract  dyadic  groups  has 
also  been  discussed. 


Radamard,  skev-Hadamard,  circulant 
and  back-circulant  matrices  have  been 
discussed  by  various  authors II]  -  [9]  . 
An  Hadamard  matrix  H  =  (hjj)  is  a 

matrix  of  order  n,  all  of  whose  elemen¬ 
ts  'Te  +1  and  -1  and  which  satisfies 

Hif  =  nl.  I  is  the  identity  matrix. 

This  means  for  an  Radamard  matrix 
the  row  and  the  column  vectors  are 
orthogonal,  An  Radamard  matrix  iW+I 
is  called  a  skew- Radamard  if  L’T  =  -V. 

A  set  of  elf  -tents  D  =  ^  xx,  x2,  ...XjJ 

will  be  said  to  generate  a  circulant 
(1,-1)  matrix  A  =  (  a^)  if  „  = 

’’l’j-i  1  "  1  when  <1-1+:LeD  (al]  rwnbRrs 
modulo  k)  ana  -1  otherwise.  A  back- 
circulant  matrix  A  =  (atp  of  order  k 
has  a-^  =  a^+^  where  1+,1  and  l-.d 

ore  reduced  modulo  k. 

In  this  paper  ’■’8  define  a  relative 
of  the  back-circulant  matrix  which  we 
christen  the  bicirculant  matrix.  The 
eigenvectors  of  this  matrix  turn  out 
to  be  the  discrete  Walsh  f.-nctions. 
Various  troperties  »nd  some  possible 
applications  are  also  discussed. 


Defiritlop;  \  bicirculant.  matrix  3  = 
<bi,.1>  of  order  n  =  ^  is  defined  bvs 

(1)  bi,.i  *  *J,i  =  bn2_m-m.n2^l+1  ? 

i,i^n2*m 

(ii)  bi?21+j  s  bbjt2*+i  ’ 


Examples  A  fourth-or-'er  Ri  ci  rculant 
matrix  34  i  s  given  below: 


An  eight h-or^er  M circulant  matrix  Rp 
will  similarly  be: 


where  3.  and  B.  ore  t’-x)  J1  struct 
order  bicirculant  matrices. 


fourth 


We  notice  that  a  '*'1  c1  rcuiX^r*^ 
matrix  is  symmetrical  about  both  pf  its 
diagonals,  further,  sucb  a  matrix  can 
be  shown  to  be  constructed  from  second- 
order  sub-matri  ces  w*d  <*b  are  all  fnarnn- 
et ideal  about  Roth  di agon»l s.  TMs  pives 
us  a  simnle  nrocp'bjpe  to  arrange  the 
elements  of  such  a  matrix.  In  other 
vrords: 


Lemma  1 

Let  81  j,  (1,.i  =  satiafv 

the  conditions  on  b^  ^  in  fRe  aRp,re 

definition,  ^rtber,  let  R,  ^  tv,emae1’-’pa 

be  bicirculant  matrices  of  order  >?.,  fRer 
3  =  (Rj-j)  is  also  a  c1  "ci’l  ant  matrix 

of  ordex*  VM. 
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ex;  -TV  , 


Mfi" 


&aaa&J2 

If  fl  olid  C  are  ticirculart  matrices 
cf  the  sue  orders,  so  is  their  product 
3C.  Generalizing  ary  B11^  ^ild  oj  so  be 
a  bicirculont  motrix. 

Proofs  Since  the  elements  of  a  b'ctrcn- 
lant  matrix  circulate  ir  pairs,  apd  are 
symmetric  about  both  the  main  diagonals, 
the  product  matrix  'dll  repair  these 
properties.  Ilso  it  follows  that 


parts  of  Lemma  3  «e  str°i £ht»-,ay  make 
the  transition  to  the  following  results 

Theoreu  S 

Bis  diagonalized  with  the  Fada- 
mard  matrix  »s  the  modal  matrix.  Kethe- 
m»ti callys 

(F3H)  =  D 

’•'here  D  is  the  diagonalized  (spectral' 
matrix  and  F  the  order  of  M  and  3. 


Theorem  3 

9icirculant  matrices  commute.  Or 
3C  =  C3. 

Lemma  4 

The  product  matrix  3F,  where  H  is 
an  Hadano’rd  matrix,  h«s  orthogonal  col¬ 
umns.  On  the  other  hand  the  matrix  vn 
has  ortbogoral  rows. 

Proofs  toy  ”adamard  matrix  of  order  211 
can  be  shown  to  be  built  up  from  Hsda_ 
nard  sub-matrices  of  lower  orders.  These 
sub-matrices  have  the  sue  sign  alter¬ 
nations  a s  vnuld  be  obtained  in  a  Hsda- 
mnrd  matrix  of  that  order.  Thus  if  H  is 
a  I’odamard  matrix  of  order  32s 


Hemark:  We  assume  that  the  Fadamard 
matrices  being  used  above  are  symmetric. 

Since  (h)  is  the  mo-’al  matrix,  its 
columns  vuvli  be  the  eigenvectors  of  9. 
However  the  colimns  of  u  a~e  the  d! s- 
crete  Walsh  functions  in  a  natural 
ordering.  Therefore  the  bicirculont 
matrix  B  has  the  Walsh  ‘'unctions  as  its 
el gervectors. 

Theorem  P 

The  ith  eigenvalue  o'*  B,  Xpis 
given  bys 

Xi  =  b1.1  h.1i 


"1  rl  nl 

'h  *1 

H1  -«!  -«l 

-Hi  -Hx 

where  F,  i  s  another  *-’adanard  matrix  of 
order  8.  Or  F  is  seen  to  be  a  Kronecker 
(or  direct)  product  of  two  -adairard 
matrices  of  orders  8  and  A.  This  is 
generally  expressed  as  the  result  that 
the  Kronecker  product  of  tws  Hadamard 
matrices  of  orders  11  ard  F  is  arother 
Hadamard  matrix  of  order  Iff5.  Therefore, 
using  Lemma  1  ,  the  product  BH  could 


be  expressed 

h  **  h  K 

fts: 

X 

V 

"1 

h 

S2  31 

34 

CO 

CO 

TT1 

u 

‘1 

H1 

-H1 

3  B. 

3, 

3 

H 

H, 

-H 

-H, 

3 

1 

2 

1 

1 

1 

1 

3  3 

3 

B 

H 

_u 

-H 

u 

.  4  3 

2 

.  1 

~'1 

1 

'  1. 

where  the  bicirculont  matrix  3  has  also 
been  expressed  as  being  built  out  of 
sutoiatrlces  3^  s  .  Carrying  out  the 
above  multiplication,  «nd  repeat! ne  the 
procedure  for  each  element  of  the 
product  3H,  shows  the  correctness  or 
the  first  part  of  lemma  3.  The  second 
part  is  proved  similarly. 

Combining  the  results  of  the  two 


Hi 


Proofs  The  product  matrix  Bw  equals 
Xk  On  pre-mvitlpli  cation  ’-ith  the 

modal  matrix  JL  ( P)  =  hj  j/F,  the 

spectral  matrix  D  =  j)  becomes  d11= 

Xj  I.  Or  the  eigenvalues  of  3  ope  the 

scalar  products  of  the  first  ro”  of  B 
with  various  columns  of  u.  Ttois  if  the 
elements  of  the  first  row  of  3  are  h, , 
bg,  b^,  b4,  the  four  el genvalues  are: 

*1  =  bl  *  "°2  +  b3  +  b4 

X  ~  b.  -  b  +  b  -  b 

A 2  12  3  4 

>  =  b  +  b  -  b  -  b 

a3  1  2  3  4 

=  b  -  b  «  b  *  b 

X4  bl  2  3  4 

This  implies  that  the  eigenvalues 
of  3  world  be  non-zero  onlv  if 


b^  h  $  0  for  all  i. 

Hemark:  let  the  seorence  h. .  he  conver¬ 
ted  into  ap  analog  v»ve<‘om;1in  the 
following  manner  •  por  a  sequerce 
n  v.ni t s  long,  divide  the  Interval 
[-f,  X  )  into  n  equal  parts.  Let  the 
magnitude  at  the  first  part,  I.e., 

[-■*,  (2-r)/2n),  equal  bin  ,  that  o** 
the  second  b.g  and  so  on.  The  resulting 
stepped  waveform  i  s  -’pained  os  th$ 
complementary  analog  ’•’ave  (C*W)  h^(t). 
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The  above  result  can  be  expressed  alter¬ 
natively  asj 

The  eigenvalues  of  B  are  non-zero  if 
the  Walsh-Fourier  transform  of  b^(t)  is 

non-zero  over  the  sequency  spread 

[  -2n-1  ,  2n-13  ,  where  2°  is  the  order 
of  B. 


Representation 

We  study  some  particular  bicireulent 
matrices  Milch  have  applications  to  the 
theory  of  dyadic  groups  and  their  rep¬ 
resentation  in  linear  spaces. 

A  bicirculant  matrix  of  order  2n  will 
lead  to  211  independent  (1,0)  matrices 
if  bj  =  <S13  with  }  =  1,2,3, ...,2n  in 

tum.  Thus  for  a  fourth  order  matrix  ve 
eet  the  four  independent  matrices  as: 


Further  since  al]  these  matrices  satisfy 
the  conditions  of  Theorem  6,  their 
eigenvalues  are  non-zero,  and  they  have 
Walsh  functions  as  their  eigenvectors. 

It  will  now  be  3hovn  that  these  matrices 
are  extremely  important  in  the  represen¬ 
tation  of  dyadic*  groups. 

Hr  Abelian  (  or  commutative)  group 
can  »lso  be  represented  as  a  matrix  set 
in  a  linear  space.  Let  G  be  an  Abelian 
group  of  n  elements 

*0  ,  ••»»  ®g,....»a1 

with  group  operation  □  .  Then 

*i D  8j  *  \ 

=  □  ai 

One  can  now  construct  an  n-dimenslonal 
vector  space  L  with  a^  as  the  basis 

vectors.  A  representation  of  the  group 
G  In  the  linear  vector  space  L  is  a 
correspondence  between  the  group 


elements  of  G  and  certain  matrices  of  I 
such  that  the  product  of  the  matrices 
preserves  the  ercnip  oper»ti on. Thus  1^: 

HO  ^  and  M(a^) 

where  the  element  a,  mans  into  the 
matrix  M(a^)  in  L,  then 

M(aj)  KC^)  =  H(^) 

One  important  ran re sent *ti or  of  an 
Abelian  group  is  the  regular  rerre°er- 
tation.  This  is  defined  os  the  set  of 
matrices  of  real  numbers  Milch  corres¬ 
pond  to  the  elements  of  G  such  th«t  the 
product  of  t’ao  such  matrices  cov'esronds 
to  the  element  of  G  giver  bv  the  croup 
multiplication.  In  short,  it  rep resorts 
a  homomorphism  of  »n  abstract  group  into 
a  group  of  real  matrices. 

^nite  dyadic  groups  have  &  elements. 
A  simple  abstract  -’voajc  consists 

of  two  elements  1  »rd  *  where  d"  *  "> . 

A  realization  of  primary  importance  for 
such  groups  is  the  Mpary  p-tunlet.s 
taking  on  the  values  f  a‘pa  i  «t  e*ch 
position  of  n-tunleta  «ith  the  group 
operation  being  action  modulo  2.  In 
Rosephloom  [l1]  At  has  beer  shown  that 
the  regular  representation  for  a  wipnrv 
n-truplet  realisation  or  abstract  ivn^e 
droups  are  the  matrices  listed  in  the 
beginning  of  this  section,  i.e.,  matri¬ 
ces  obtained  bv  nuttine  bj  =  6^  in 

turn  for  .1  =  a,  1, ....,  n-1  in  B.  V 
since  be  Wqish  'lipctions  "re  a  natural 
bases  'or  a  W-  d^mersioral  vector 
space  corresponding  to  a  2n  element 
Abelian  group  with  na<aition  modulo  2  «s 
the  group  operation,  they  turn  out  to 
be  tho  eigenvectors  of  the  above-ment¬ 
ioned  regular  representation.  Tr  tMs 
paper,  using  the  property  of  hi  circular 
matrices,  this  result  h«s  been  ohfaired 
otherwise. 

.  The  group  property  of  the  recrlar 
rep  re  sept ati on  will  he  exnlicitlv  stated 
Let  R£,  i  =  0,1, ,...,n-l  be  the  regular 
representation  in  a  n-dimensioral  vector 
iPoce.  The  matrix  RJ  is  obtained  bv 

putting  b^  =  ^  in  the  eeneral  hi- 

ci  mil ar  matrix  B.  Thus 


We  can  now  eesilv  '•'rite  the  following 
result . 
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Hjgaian  7 

For  1^  defined  ns  above 
^  Ri  =  0 J 

where  1  ©  J  represents  addition  modulo 
2  after  i  and  j  have  beer  put  in  a 
binary  representation. 


Examples. 


since 

ii) 


0  0© 


1  1 


■  f 


1  1 


since  for  any  i  addition  modulo  2  yields 
a  sequence  of  zeros.  Thus 

1  0  0  1  1  1  0 
©1001110 


used  to  analyze  data.  po«ever  ary  such 
analysis  waul-1  be  equivalent  to  expand¬ 
ing  the  data  in  a  ’--eighted  series  of 
Walsh  functions. 
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In  this  paper  we  define  and  study 
bicirculant  matrices.  Their  irtimate 
relationship  with  the  regular  repre¬ 
sentation  of  abstract  dyadic  groups 
is  discussed  in  addition  to  oossible 
applications  as  stochastic  matrices. 


Blcirculont  matrices  cap  also  be 
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P.L.  Butzer  and  H.J.  Wagner 
Technological  University  of  Aachen 
Aachen.  Germany 


1.  Introduction 


In  a  recent  paper  the  authors  (  3  ] 
defined  a  derivative  for  functions  f 
given  on  the  dyadic  group  G.  This  deri¬ 
vative  turned  out  to  be  a  linear, 
closed  operator,  its  inverse  operator 
or  integral  was  introduced, and  the 
fundamental  theorem  of  the  calculus  was 
found  to  hold  for  these  two  concepts. 
This  enabled  one  to  obtain  first  results 
on  the  approximation  of  f  by  the  partial 
sums  of  the  Walsh-Fourier  series  of  f. 
The  purpose  of  this  paper  is  to  present 
the  definition  of  the  derivative, this 
time  in  its  setting  on  the  unit  inter¬ 
val  i  0,1  ],a8  well  as  to  give  a  new 
application,  namely  to  establish  the 
fundamental  theorem  on  best  approxima¬ 
tion  (in  the  version  of  (1,2]  for 
functions  f  defined  on  [  0,1  ]  by  Walsh 
polynomials. 


2.  Preliminary  results 

Defining  the  Rademacher  functions  by 
.  ,  fl,  0<x<l/2 

*o(x)  =(-1,1/2<x<1  »  V0(x+1)=  $0(x)  , 


*n(x)  =  <frc(2nx)  (neN  =  (  1,2,...}), 

then  the  Walsh  functions  are  given  by 


(2.1)  ’P0(x)  =  l,,i'n(x)=4.n^(x). . .  $n.(x) 
nl  ni 

n=2  +. . .+2  ,nj  >  . . . >  n^  >  0,  n^  being 

integers.  Let  G  be  the  dyadic  group 
consisting  of  all  sequences  x  =  (xn}^=1 
such  that  x  =0  or  1,  the  operation  of  G 
being  addition  modulo  2  (notation  -r). 

G  is  related  to  the  unit  interval  by 
the  mapping  A :  G*l  0,1  ] 


Mx> 


7  "  2"n  x 

*n=l  d  xr 


>.  does  not  have  a  single-valued  inverse  1 
since  the  dyadic  rationals  (=D.R.)  have 
two  representations  in  G.  We  shall 
agree  to  take  the  finite  expansion  in 
that  case.  If  p  is  the  inverse  of  X, 
then,  according  to  N.J.  Fine  (  A  ]  ,  one 
has  for  all  real  x 

X(p(x))  a  X  -  I  X  ]  , 

[  x  ]  denoting  the  greatest  integer  <  x. 
Moreover,  p(X(x))  =  x  for  all  x  e  G 
provided  X(x)  t  D.R.  Denoting 
X(p(x)  +P(y))  in  short  by  x  ®  y,  then 
Fine  (  A  ]  showed  that 

l  1 

/  f ( x  ®  y )dx  =  /  f ( x ) dx 
o  o 

for  every  fixed  y  provided  that  f  is 
Lebesgue  integrable  on  10,1].  Further¬ 
more,  for  each  fixed  y  ar.d  for  all  x 
outside  a  certain  denumerable  set 
(depending  on  y),  one  has 

(2.2)  <Pn (x  ®  y)  =  yn(x)  Vn(y). 

More  generally,  (2.2)  is  also  valid  for 
all  (x,y) e  (  0,1  ]  x  I  0,1  ]  outside  a 
denumerable  set. 

A  finite  linear  combination 

Ik-o  ck  yk^x^  bein6  complex  numbers) 
is” called*a  Walsh  polynomial  of  degree 
n,  the  set  of  such  polynomials  of  degree 
<n  being  denoted  by  Pn.  If  pm  e  ?^n> 
h  e  (0,2“n),  then,  outside  the  above 
denumerable  set, 

(2.3)  Pm(x  •  h)  =  Pm(x). 


Denoting  by  LP(0,1),  l<p<“,  the  set 
of  all  functions  f  of  period  1  which  are 
pth  power  integrable  with  norm  I fB  = 

Ifl  ={Ja|f(x)|Pdx  }1/p,  it  is  known 
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that  tne  Walsh-system  is 

closed  with  respect  to  the  space  Lp(0,l), 
i.e. , 

(2.4)  f‘(k)=0,  k  £  P ,  — >  f(x)=0  a.e. , 


the  Walsh-Fourier  coefficients  of  f 
being 

f~(k)=  /1f(u)vk(u)du  (k£P=(o, 1,2, ...)). 

By  (2.2)  for  each  real  y  and  k  t  P 

(2.5)  /Xf(y  •u)*k(u)du  =  *k(y)f*(k)  . 

Defining  the  convolution  of 
feJ.p(0,l)  and  grL1(0,l)  by 

(f*g)(x)  ~  /1f(x  ©  u)g(u)du 

o 

1 

=  J  f(u)g(x  9  u)du  , 

it  is  also  known  that  f  #  g  exists  for 
almost  all  real  x,  f*geLp(0,l)  and 


(2.6)  Jf  «gHp  <  DfBpDgllj  . 

Moreover,  it  is  obvious  that  for 

f e  LD(0,1) 

| f“(k) |  <  D  f D  (k  e  P), 

and  the  convolution  theorem  states  that 
for  f.g  e  L1(0,1) 

(2.7)  (f«g)*‘(k)=f'‘(k)  .  g'‘(k)  (k  e  P). 

Finally,  if  fn,f  eLp(0,l) ,  neN,  then 
for  all  k  e  p 


(2.8)  limlf  -f*  =  0=*.lim  f*(k)  =  f'(k) 


3.  The  Derivative  and  its  properties 
Definition 

If  fcr  f£Lp(0,l)  there  exists 
geLP(0,l)  such  that 

(3.1)lini|l?,02j(f(«>  f(.©  2"j"1)]-g(»)l*a 

nr*®  J 

then  g  is  called  the  strong  derivative 
of  f,  denoted  by  D* f .  For  r=2,3,... 
the  rth  strong  derivative  of  fe  LP(0,1) 
is  defined  successively  by 

D^  f  =  D*  ^  D*  r-1^  f  . 


Note  that  this  definition  differs 
from  that  given  by  J.E.  Gibbs  15  J 
essentially  in  the  sense  that  the  factor 
2J  is  replaced  by  2“3 ;  however,  Gibba’ 
definition  is  taken  in  the  pointwise 
sense. 

D^ r'  is  a  linear  operator  with  the 
property 
Proposition  3.1 

(3.2)  vf  rI  Yn  =  nrVn  (n  e  P.reN). 

Using  (2.2),  the  proof  for  r=l  follows 
readily  from  the  identity  (n  e  P) 

(3.3)  l5Z0  2^1  l-’rn(2-0"1)]  =  2n  . 

To  prove  (3-3),  note  that  for  m,j  e  P 
$m(2"j-1}  =  <J>0(2m  2-j-1)  =  -1  for  m=j, 

*1  for  m*  j .  Then  apply  (2.1). 

Hence  Walsh  polynomials  are  arbitra¬ 
rily  often  differentiable.  Furthermore, 

(3.3)  together  with  (2.8)  implies  that 

(DlrJf]~(k)  =  krr*(k)  (k  £  P) 

under  the  existence  of  D^  f  eLp(0,l). 

It  is  obvious  that  the  strong  derivati¬ 
ve  of  a  constant  vanishes  and,  converse¬ 
ly,  1)1  f  =  0  implies  f  =  const,  in 
view  of  (2.5),  (3-3),  (2.8)  and  (2.<0. 
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Of  importance  is  the  function  Wr(x) 
defined  by  (see  Watari  [7]) 


Wr  00  =  _ 


(1  ,  k  =  0 


k"r,  k  e  N 


(r  e  «). 


Having  the  theory  developed  in 
Butzer-Wagner  (33  at  our  disposal^it 
can  be  shown  by  parallel  methods  that 
Wr(x) e  L1(0,1).  Moreover,  if 
f ,8  e  LP(0,1)  such  that  krf*(k)=g~(k), 
k  e  P,  r  e  N,  then 


f  =  Wr  »  g  +  f“(0) . 


Theorem  3.1 


Let  f  £  LP(0,1)  such  that  f*(0) 

=  /„*  f(x)dy  =  0. 

a)  If  there  exists  l/r'f  eLp(0,1)  for 
some  r  e  N,  then 

(Wr  *  1^  rl  f)  =  f 

b)  d  rJ  (Wr  *  f)  =  f  . 

This  theorem  may  be  regarded  as  the 
fundamental  theorem  of  the  calculus  for 
our  concept  of  a  derivative.  In  this 
sense,  our  operator  of  integration  I  is 
given  by 

If3(W.#f)  =  /  f(x  ©  u)W.  (u)du  . 

1  o  1 

It  is  obvious  that  I  is  linear  and  con¬ 
tinuous.  Or  the  other  hand,  it  can  be 
shown  that  the  operator  ri  r)  of  diffe¬ 
rentiation  is  closed  on  LP(0,1). 

All  of  the  results  established  in 
Butzer-Wagner  (  3] ,  including  the 
applications,  carry  over  from  the 
dyadic  group  G  to  the  interval  (  0,1]. 
The  following  new  applications  are 
proved  in  detail. 


*l.  Applications  to  Approximation 
by  Walsh  Polynomials 

In  the  notation  of  G.W.  Morgenthaler 
16  3  define  for  f  eLP(0,l),a  >  0 


Lip  o(W)={f;Df(.)-f(««  h)ll  =  0(ha),h-o*} 


“w(f;$)=  supllf(»)-f(»  ®  h ) il  , 

"  0<h«5 

E  (f)  =  inf  Ilf  -  p  1, 

P«eP„ 

n  n 

the  latter  quantity  being  called  best 
approximation  of  f  by  Walsh  polynomials 
of  degree  n  in  Lp(0,l)-space.  It  is 
known  that  there  exists  a  Walsh  polyno¬ 
mial  p*  (=p*(f))  of  best  approximation 
to  feLP(0,l)  for  which  En(f)=l|f-p*  fl. 


According  to  Morgenthaler  and  Watari 
(  81  it  is  known  that  for  6  ->  0 


(4.1)  fsLip  a(W)«^uw(f;6)=  C?(Sa), 

(4.2) 

respectively.  Analogous  to  (3)  we  have 


Proposition  4.1 

If  pi  r]  f  exists  and  belongs  to 
Lp(0,l),  then 

“w^'pi*  =^^nr  UW(E>*  lf;^n  ^  1  ’ 

Of  fundamental  importance  are  the 
Bernstein  and  Jackson-type  inequalities 
given  by 

Proposition  4.2 

a)  J'or  pn  e  Pn  one  has 

D  eJ  rnB<  Anrfl  pn  ||  (n  e  P,r  e  N). 

b1  If  f  exists  and  belongs  to 
LP(0,1),  then 

En(f)  <  Bn~r  8  eJ  rl  f  B  . 

Here  A  and  B  are  constants  independent 
of  n,  pn,  f. 
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Proof 


If  n  has  the  representation  (2.1), 
then  pn e P  n  +j.  By  (2.3)  one  has 


-  II ^  p  II 
n  *V 


1  ni  i  "l  j“ni 

<  iy .  2J  ii  p  ii  <ii  p  ii  y .  2  <  2  n  p  n . 

n^j=o  V  V‘j=o  *v 


To  prove  (iii)=>(iv)  first  note 
that  (iii)  implies  II  U,*  il  =  Cl  2“1{(ct+r)]  » 


where 


*  [  pk  ”  p  k-1’  k=2,3>.**> 

U*  =  I  2k  2k  1 

(  Pj  ,  k=l  • 

Therefore  by  Prop,  4.2  a)  for  k  e  N 

(4.3)  IID|V,U^I  =6i2k(v“a"r)  ]  . 

Now  the  sum  converges  in 

Lp(  O,l)-norm  to  f.  Since  vor  0  <  v  <  r 


The  proof  of  a)  now  follows  by  induc¬ 
tion. 

Under  the  hypotheses  of  b)  the 
assertion  of  b)  follows  immediately  by 
(4.2)  and  Prop.  4.1. 

The  following,  which  is  the  fundar 
mental  theorem  on  best  approximation  by 
Walsh  polynomials,  shows  the  usefulness 
of  our  derivative  concept. 


Theorem  4.1 

If  f  e  LP(0,1),  the  following  state¬ 
ments  are  equivalent: 

(i)  DIr]f  e  Lip  a(W)  (a  >  0), 

(ii)  u,w(D[rJf;  i)  =  0(n~a) , 

(iii)  En(f)  =  0( n"a~r), 

(iv)  Dlvl  f  e  LP(0,1),  0<  v  <r, 

II  D{  vJ  f-D1  vl  P;il  =  0  (n+v-a-r)  , 

(v)  HDI1]p‘  II  =  £>(n1-0~r)  (0<  c+  r<l) . 


Hk“l  JV,0jl  <  Cl™!  2k(v-«-D  <  », 

there  exist  functions  g^  e  LP(0,1)  with 

“»•  l=i J,1»;  - 

Iv  1 

Since  the  operators  D  are  cTosed, 
rfvlf  s  gv  for  0  <  v  <  r.  By  (4.3)  we 
have 


II  B1  V|(T-p'  )ll  .IB1''1  B1  vl  B  '  II 

Blv)Uk'l  .  Oi  8"<v-— •)  1  . 


Now  for  2ffi  <  n  <  2m+1  one  has  by  (4.3) 
II  Dl  v)  (p*-p*<m)ll  =  0(nv"ct”r) .  Combining 

the  two  inequalities  yields  (iv). 


(iv)=^(ii)  by  (4.2).  It  remains  to 
show  that  (iii)<^?- ( v) .  This  follows 
along  standard  lines,  compare  Butzer- 
Scherer  [  l,p.il8  f,  or  2  ]  . 


/ 


/ 


Proof 

The  equivalence  (i)$=>(ii)  follows  by 
Morgenthaler  ( 6]  (who  considered  case 
r  =  0;  see  (4.1)). The  implication 
(ii)=?(iii)  follows  by  (4.2)  and  Prop." 
4.1. 


In  contrast  to  the  situation  for 
classical  Fourier  series,  the  assertion 
(ii)  need  only  be  formulated  for  the  mo 
dulus  of  continuity  of  the  first  diffe¬ 
rence  . 
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/ 


/ 


The  results  of  this  paper  may  also  be 
established  for  the  space  L"(0,1), 
taking  into  account  slight  modifications. 

/ 

The  contribution  of  the  second- 
/  named  author  was  supported  by  the  Mi¬ 
nister  fUr  Forschung  des  Landes  Nord- 
rhem-Weslfallen  -  Landesamt  fUr 
Forschung. 

/ 
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Abstract 


A  NSW  EYE  ON  WAI33  FUNCTIONS 


Claude  CARDOT 
Senior  Engineer 

CIT-ALCATEL  -  Harcoussis^t )-FRAI!CE 


We  introduce  two  new  algebraic  represen¬ 
tations  for  Walsh  functions.  The  sign  of  a 
trigonometrical  product  allows  to  compute 
Fourier  spectrum  and  to  classify  Walsh  func¬ 
tions  into  diaphonic  equivalence  classes.  A 
polynomial  representation  gives  the  key  to 
the  convolution  products  of  any  two  Walsh 
functions.  A  theoretical  consequence  is  the 
fact  that  y  distinct  convolution  products 
only  exist  in  a  class  containing  2*  Walsh 
functions.  Practical  consequences  are  formu¬ 
las  for  the  influence  of  limited  bandwidth, 
additive  noSse  and  synchronization  error  in 
the  operation  of  a  Walsh  carrier  multiplex. 

Notations 

The  definition  interval  for  Walsh  func¬ 
tions  will  be  s  (-'It  rflTJ  ). 

x  will  be  the  indopondant  variable. 

Compared  to  usual  notations,  we  shall 
have  x  =  2  TT  6. 

w(N,x)  (N  integer)  will  be  the  value  of  the 
Walsh  function  of  rank  N  if  the  Walsh 
functions  are  3equencv  ordered  and 
numbered  from  0  to  2k  -1 . 

w(N,i)  (N,i  integers)  will  be  the  constant 

valu6  (+  1 )  of  if(N,x)  on  the  interval 
number  i  of  its  definition  period. 

i  9  j  will  denote  the  direct  sum  of  integers 
i,  j. 

i  +  i  will  denote  the  C-aum  of  two  binary 
numbers  with  k  digits,  the  result 
being  a  k-digit  ternary  number  with 
the  rules  :  +  ^  _  + 

c 

0  +  0  =  -  1 
;  Jo  =  o  +  i  =0 

The  word  simple  will  keep  its  standard  English 
meaning  and  the  words  :  spectrum.  Fourier 
aeries,  their  classical  trigonooatrical  sense. 

A  Walsh  carrier  is  an  indefinitely  repea¬ 
ted  Walsh  function. 

The  word  diaphony  is  used  here  as  an  equiv¬ 
alent  to  "crosstalk w. 


The  2*  first  Walsh  functions  being 
aequency  ordered  from  N  =  0  to  N  =  2^  -1 ,  and 
their  sign  being  normalized  jo  that 
W(+  0,x)  =  +  1  for  ail  N,  we  have  : 

W(i,  x).  W(j,z)  =  w(i  «  j,x),  i,j  integers. (l) 

The  operation  9  defines  an  Abelian  group 
on  the  k  binary  digits  integers. 

Integers  with  orr.  single  1  _r.d  (k  -  i) 
zeroes  constitute  a  simpls  generators  jot  for 
this  group.  If  no  generator  is  repeated  in  a 
sum,  direct  aua  is  identical  to  normal  addi¬ 
tion  for  this  set. 

These  integers  are  powers  of  2.  So  that 
if  we  operate  the  dyadic  decomposition  of  H  t 

(l)  Ns  Sa,.  2‘’'1  a.  -  0,1  and  o=1,2,.r., 
J  o  «J 

ve  shall  have  r 

W(N,x)  =  IT.  W(2^~\x)  the  product  being 
for  ell  j  such  that  =  1 . 

Now,  W(l,x)  is  the  first  Rademacher 
function,  and  we  have  s 

W(l,x)  =  W(2°,x)=sga  (sin  x)=sgn(cos(x  -  *^2)) 

W(2,x)  is  the  same  function  cyclically 
shifted  and  wo  heve  s 

W(21,  x)  =  sgn(cos  x),  and  : 

V(22,  x)  =  8gn(co^  2  x) 


V(*  ,  x)  =  agn  (cos  z  x) 

all  these  functions  being  cyclically  shifted 
even  Rsdeaacher  functions,  with  orders  from 
1  to  k-1 . 

Tne  operation  "sgn,:  commutes  with  multi¬ 
plication,  so  that  any  Walsh  function  can  be 
obtained  as  the  sign  of  a  trigonometrical 
product,  defined  as  follows  by  the  bits  1  in 
K  : 

-  tho  iirst  bit  from  right,  if  1,  giwes  a  fac¬ 
tor  :  sin  x, 
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-  the  second  bit  from  right,  if  1 ,  gives  a 

factor  s  cos  x, 

-  the  third  bit  from  right,  if  1 ,  gives  a 
factor  i  cos  2  x 


-  tho  bit  of  rank  k  from  right,  if  1,  gives 
a  factor  :  cos  2^z. 

With  the  defined  in  ( 1 ) ,  we  have  : 
W(N,x)=sgn  cos  aj  (x~ 'fl/2)  cos  (a.2^-2x) 


This  formula  allows  to  compute  the  2^ 
first  Walsh  function  with  k+1  storage  regis¬ 
ters  only,  on  any  computer  with  a  cosine 
subroutine,  k  registers  are  needed  to  store 
the  a .  and  one  more  to  effect  the  trigonome- 
tricai  product. 

To  implement  this  formula,  x  shall  be 
restricted  to  the  mid-interval  values,  so 
that  the  sign  extracting  sequenco  cannot  fail 
on  a  zero.  Setting  :  x  =  (2i-1  )^/2^  ; 
i  =  (l-2k-1)»...  2^-1,  the  preceeding  formula 
becomes  : 

W(N,i)=sgn  003^(21-1)772*  -  ^2  . 

cos(a.(2i-l)  2j“1  W2k+1) 


.  odd  N  case  : 


n=_<* ,  f  TT 

uiW=Zj  iff-  sin  nx  I  cos  -j~-  n(i-1 ) 

nt  .1 

-  cos  -2~  mj 

and,  reporting  thi3  in  (4),  we  derive  : 

Even  case  :  (N  =  2  s)  : 

?  1^2*' 1 

W(2s.x)  =  ^  ™  (cos  nx)  W(2s,i). 

[«-  P  - ® 

Odd  case  i  (M  =  2s  **  1 )  : 

i^"1 

W(2s-1,x)  =  ]F?  ~j(sin  nx)  W(2s-1,i). 

n=T  i  =  1 

the  coefficients  W(N,i)  in  (5)  and  (6)  being 
computed  from  (3). 


Trigonometric  series  for  a  Walsh  carrier 


If  we  write  a  Walsh  carrier  under  the 


W(N,x)  ^  w(N,i).  u  (x) 

i  =■  1  1 


i  -  1,  2...  2  describing  the  right 
half  of  the  period  and  the  u,(x)  being  2*“ 
orthogonal  functions  obtained  by  infinite  re¬ 
petition  of  : 

-  a  function  equal  to  +  1  on  intervals  +  i 
and  (l-i)  of  fundamental  period,  if  H  is 
even,  and  zero  elsewhere, 

-  a  function  equal  to  J.  1  on  interval  +  i 
and  to  -  1  on  interval  (l-i)  if  N  is  odd, 
and  zero  elsewhere. 


The  trigonometric  series  for  u.(x)  i3  : 

.even  N  case  :  u.(x)  =  /.  — —  . 

1  n?1 

nx  |sin  ni  -  sin  n  (i~1  )J 


Spectra  classification 


Theorem  1 .  If  kg  is  the  rank  of  the  first 
non-zero  bit  from  right  in  the  seouenev.  then 
Walsh  carriers  with  this  sequenev  shall  have 
spectral  lines  on  odd  multi-plea  of  2gQ1 . 

Proof  :  sgn.cos  z  and  sgn.sin  z  have  spectral 
lines  on  odd  multiples  of  z. 

Now,  let,  in  binary  notation  : 

s  =  xyzIO  ;  xyz  being  any  binary  digits 
(kg  =  2  in  this  case) 

2s  =  xyzlOO  ;  W(2s,x)  =  sgnTr(x).cos2k°  xl 

*  U)  r  ko-a 

2s-1=xyz011  ;  W(2s-1,x)  =  sgn/Y  (x)  .sin  2  x 

V1  T 

sin  2  x..  sin  xj 

Applying  kg  times  from  right  to  the  last 
expression  the  identity  :  sgn  (sinx.cos  x)  = 
sgn  sin  2x,  we  see  that  s  1 

W(2s-1,x)  =  sgn[Y(x).  sin  2*°  x  ] 

l(x)  containing  only  oosinoB  of  higher 
frequencies,  the  theorem  results.  The  cal 
function  contains  cosines  of  odd  multiples  of 


*0 

2  x  tnd  the  sal  function  sines  of  the  same 
frequencies . 

A  result  from  this  theorem  is  that  if 
an/  two  Walsh  carriers  share  one  Fourier  com¬ 
ponent,  they  share  them  all,  so  that  sharing 
one  Fourier  component  is  an  equivalence 
relation. 

The  equivalence  classes  thus  obtained 
can  be  labeled  by  and,  for  each  value  of 
k^,  there  will  be  two  classes  :  one  for  even, 
and  one  for  odd  functions. 


Inside  each  class,  the  functions  can  be 
sequency  ordered  by  the  bits  at  left  of  the  2  Walsh  multiplex 

first  non-zero  bit  in  s.  Obtained  rank  will 

be  named  the  dianhonlc  equivalence  number. e.  Ve  suppose  here  that  i 


It  i3  easy  to  see  that  there  arp  2  k 
classes  in  the  group  formed  by  the  2K  first 
Walsh  functions. 

Table  fig.  1  shows  these  10  classes  for 
the  32  first  Walsh  functions,  with  the  cor¬ 
responding  e-ordering. 


Rank  1 

Vj 

Sven 

functions 

Sequency  , 
s 

ko 

e 

Odd  ) 

function! 

Rank 

N 

’■*  0 

cal  (  0,  x ) 

0 

-1 

- 

... 

3 

cal  (  1,  x) 

1  -  0001 

1 

f 

sal  (  1,  x) 

1 

6 

cal  <  3,  x) 

3  ~  0011 

1 

Ml  (  3.  X) 

5 

10 

cal  (  5,  x) 

5  rm  0101 

2 

sal  (  5,  x) 

9 

14 

cal  (  7,  x) 

7  0111 

3 

Ml  (  7,  I) 

13 

18 

cal  (  9,  x) 

9  re  1001 

4 

sal  (  9,  x) 

17 

22 

cal  <11,  x) 

11  «  1011 

5 

sal  (11,  x) 

21 

26 

cal  (13.  x) 

13  «  1101 

6 

sal  (13,  x) 

25 

30 

cal  (15,  x) 

15  *=  till 

7 

sal  (15,  x) 

29 

4 

c*l  (  2,  I) 

2  0010 

2 

0 

sal  (  2,  x) 

3 

12 

cal  (  6,  x) 

6  ~  0110 

1 

sal  (  6,  x) 

11 

20 

cal  (10,  x) 

10  ~  10*0 

2 

sal  (10,  x) 

19 

28 

cal  fU.  x) 

14  ~  1110 

3 

lal  (14,  x) 

27 

8 

cal  (  4,  x) 

4  ~  0100 

3 

0 

sal  (  4,  x) 

7 

24 

col  (12,  x) 

12  -y  1100 

1 

sal  (12.  x> 

23 

16 

col  (  8,  x\ 

8  s  1000 

4 

0 

sal  (  8,  xi 

15 

16  r->  10000 

5 

0 

sal  (16,  x) 

31 

- 

— 

- 

-  the  a.  are  constant  during  a  period  of  the 
Walsh  carriers, 

-  there  is  neither  synchronization  error  nor 
additive  noise  (N(t)  =  o); 

-  tho  line  is  a  rectangular  low-pass  filter. 

cutting  off  all  spectral  components  with 

n  n  and  having  no  effect  on  the  lower 
max 

components • 


The  demodulated  samples,  s’., 
to  the  Sj^  by  the  linear  system  :3 


i=N-1 

=  v. 

i  =  0 


ij* 


are  bound 


When  low- pass  filtering  is  present,  the 
D.  ■  terms  are  functions  of  n  ,  the  cutoff 
frequency  of  the  filter.  max 

When  there  is  no  filtering  (n  =  CO  ) , 
the  D.  .  matrix  is  unitary,  because^^cf  the 
orthonbrmality  of  the  Walsh  functions  set. 

For  all  practical  purposes,  the  sign  of 
the  D. .  coefficients  is  unimportant,  so  that 
we  shall  neglect  it  in  the  sequel. 


Fig.  1  Equivalence  classes  for  the  32  first 
Walsh  functions.  Heavy  lines  separate  dis¬ 
tinct  classes. 


When  a  ^.(n^^)  coefficient  i3  identi¬ 
cally  zero,  we^say  that  corresponding  Walsh 
carriers  (N  =  i  and  N  =  j)  are  absolutely 
orthogonal  (orthogonal  for  any  "filtering;. 


Orthogonality  and  diaphony 

Consider  now  the  Walsh  multiplex  fig.  2 
where  N  =  2k  analogical  samples  3Q,...  sjj_1 
are  transmitted  through  a  line,  each  of  1 
them  modulating  a  Walsh  carrier  W(H,x)  and 
demodulation  being  effected  by  N  integrate- 
and-dump  circuits,  IT.,  fed  by  the  corres¬ 
ponding  Walsh  carriers. 


This  is  the  case  either  if  i  and  j  have 
not  the  same  parity  (The  Fourier  series  are 
made  of  cosines  for  one  of  them  and  of  sines 
for  the  other)  or  if  the  k,  values  are  not 
the  same  (The  spectral  lines  are  not  on  the 
same  frequencies). 

When  two  Walsh  functions  are  not  absolu¬ 
tely  orthogonal,  we  have  : 
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^tiSKQRgSHfe 


DiJ^KmajE^  =  5 


n-;n 

^imai 

n-  1 


ni*  nj 


(7) 


for  the  expression  of  the  filtering-induced 
diaphony  between  the  carriers  W(j.,i)  and 
w(j,x);  as  a  particular  case  : 


Dii(aaax> 


1 

2 


n=n 


ni 


(8) 


expresses  che  filtering-induced  diaphony  for 
the  carrier  W(i,x),  if  : 


tni.i) 


■•=2? 

Z3f, 


n=1 


ni 


C08 

ein 


nx 


W(j,r) 


COS 

sin 


nx 


Universal  diaphony  matrix 


In  proceeding  formulas,  i  and  j  are 
supposed  to  correspond  to  Walsh  functions  in 
the  same  equivalence  class.  In  that  case,  kQ 
being  the  index  of  that  class,  i  and  j  can  U 
be  expressed  as  functions  of  k„  and  of  equi¬ 
valence  numbers  :  e,e'  of  W(i.x),  W(j,x) 
respectively.  We  can  denote  the  D. .(n  ) 

coefficient  as  :  .  1J 


It  results  from  Theorem  1  that  classes 
with  different  values  of  k-  correspond  one 
to  another  by  a  modification  of  the  frequency 
scale  by  the  factor  2*0  ~*0,  in  particular, 
we  have  : 


e,e' 


(nmax}  = 


e,e' 


J*°  > 


That  is  to  say,  all  diaphonv  classes  are 
Isomorphic  and  are  described  by  the  same  ma¬ 
trix,  with  a  suitable  multiplication  of  the 
frequency  3cale.  An  even  class  being  eviden¬ 
tly  isomorphic  to  the  odd  class  with  the  same 
kn,  we  see  that  in  case  of  rectangular  filte¬ 
ring.  all  dinphonic  coefficients  between 
Walsh  carriers  are  given  by  an  universal  ma¬ 
trix  D  ,(n)  whose  coefficients  are  functions 
of  n,  8,0  the  lowpass  cutoff  frequency. 


Moreover,  in  the  case  of  another  type 
of  filter,  the  same  general  properties  hold, 
since  they  rely  on  the  spectra  patterns  of 
the  Walsh  functions  before  filtoring.  Of 


course,  th.  ..umerieal  values  of  the  matrix 
coefficients  shall  no  longer  be  given  by  the 
simple  expressions  (7)  and  (8),  but  by  sum¬ 
mations  taking  into  account  the  phase  and 
amplitude  characteristics  of  the  filter  actu¬ 
ally  used. 


Influence  of  Noiso  in  a  Waljh  multiplex 


Suppose  now  that,  in  fiG  2,  an  additive 
noise  aource  N(t)  is  present,  delivering  white 
gaus3ian  noise  with  spectral  power  density  N 
from  zero  frequency  to  P. 

The  noise  appearing  in  the  demodulated  \ 
channel  s' .  will  be  the  product  of  the  pass- 
band  of  this  channel  by  the  noise  density 
around  zero-frequency  in  the  demodulated  output 
s'.,  because  the  integrate-ana-dump  circuit 
act  as  a  lowpass  filter. 

Demodulated  noise  before  th<*  integrate  and 
dump  circuit  will  be  the  power  addition  of 
all  components  obtained  by  multiplication  of 
incident  noise  with  each  of  the  Fourier  com¬ 
ponent-  of  w(j,x)  : 

N-Vt)  =  N(t)  x  g  fn.  2-TTn  t/T 

(T  =  period) 

Hoise  density  of  this  product  at  zero  frequen¬ 
cy  is  s 

K'(j)  =  N  x  |  g?  f2n.  »DW(FT).  N 

because  spectral  lines  with  n^FT  give  trans¬ 
posed  noise  bands  without  component  at  zero 
frequency. 

We  see  that  noise  density  on  the  j  th 
output  is  attenuated  with  the  filtering  atte¬ 
nuation  coefficient  corresponding  to  the  upper 
noise  frequency  F,  and  to  the  j  th  Walsh 
function. 

This  results  intuitively  from  the  fact 
that  the  insertion  of  a  lowpass  filter  with 
cutoff  frequency  F  will  not  modify  the  effect 
of  the  noise. 

The  attenuation  for  the  noise  density  being 
the  same  as  the  attenuation  for  the  corres¬ 
ponding  signal,  we  see  tnat  if  the  noise  is 
white  in  the  bandpsgi  of  the  line,  the  signal 
to  noise  power  ratio  will  be  unaffected  by 
the  multiplex  transmission. 
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Diaphony  and  convolution 


If  we  compute  the  functions  Dg  _ , (n) 
in  the  universal  diaphony  matrix,  w6estate 
that  this  matrix  is  evidently  symmetrical, 
hut  moreover,  some  terms  from  different 
Walsh  functions  pairs  are  found  equal.  The 
convolution  theorem  states  that  tne  terms 
in  the  sum  (7)  are  the  Fourier  coefficients 
of  the  convolution  product  : 


Sjw 


-f 


W(i,u).  W(j,u-x)  du 


(9) 


Next  section  will  he  devoted  to  compute 
how  many  distinct  convolution  products  exist, 
to  within  sign,  in  an  equivalence  class 
containing  2^  Walsh  function. 


Polynomial  representation 


In  the  sequel,  wa  change  sign  normaliza¬ 
tion  of  Walsh  functions  so  that  s 

W(N,  -  'TT+  0)  =  +  1  for  all  N. 

We  represent  Walsh  carriers  in  the  ring 
of  polynomials  in  y,  mod(y2  -l),  with  coeffi¬ 
cients  in  the  real  numbers  field  without 
restriction. 

Jn  reference  (l),  we  give  in  extenso 
the  proofs  of  following  theorems  : 


Theorem  2  -  Any  Walsh  function  can  be  fac¬ 
torized  under  the  fora  : 

?(y)  =  (1  +  y)(i±  y2)0+y4). •••0+  y2  ) 

(10) 

If  we  associate  "+"  to  0  and  to  "1". 
the  choice  of  3igns  in  these  k  factors  gives 
the  rank  N  of  the  function  in  Gray  code. 

k  (This  theorem  is  etablished  by  proving  that 
2'  orthogonal  functions  are  so  generated,  and 
that  if  the  number  of  zero-crossing  of  the 
function  on  the  open  definition  interval 
increases  by  one,  one  sign  only  can  change 
in  (ID)). 

•Theorem  3  -  If  two  Walsh  functions  are  repre¬ 
sented  bv  the  polynomials  : 

P(y)  =  v  (i,x) 

P’(y)  =  v  (j,x) 


2  j 

thon  the  product  :  Q(y)=P(y) .P1 (l/y) ,mod(y  -l)  j 

has  for  coefficients  the  successive  values  of  j 

the  convolution  product  (9)  at  the  beginning  ; 

of  each  interval  where  Walsh  functions  are  J 

constant.  j 

2  0^—1  j 

If  Q(y)  =cf.+c,y+c?y  +..+c  .  .y‘  “  i 

0  1  *  2*-t  ! 

then  : 

Q^(®  (m  integer  from  0  to  2k~l) 

(This  theorem  is  easily  proved  by  consi¬ 
dering  the  triangular  elementary  convolution 
product  of  two  functions  equal  to  +  1  on  a 
single  interval  and  to  zero  elsewhere,  repre¬ 
sented  by  single  powers  of  y,  and  using  then 
the  bilinear  character  of  the  integral  (9) 
for  combining  these  building  blocks  into 
Wal3h  functions). 

The  convolution  product  Q. ,(x)  being 
a  succession  of  straight  segments!,  ic  ir  com¬ 
pletely  defined  by  its  values  just  obtained 
on  interval  separative  points. 

We  now  prove  the  : 

Theorem  4  -  The  convolution  product  of  any 
two  Walsh  functions  belonging  to  the  same 
diaphonic  equivalence  class  is  uniquely  defi¬ 
ned.  to  within  sign,  by  the  C-sum  :  e  +  e*  of 
their  equivalence  numbers  written  in  Gray  code. 

As  a  corollary  : 

In  a  diaphonic  equivalence  cla33  containing 
2^  functions,  the  C-sum  is  a  k-digit  ternary 
number,  so  that  3^  distinct  convolution  pro¬ 
ducts  exi3t. 


Proof  If  we  factorize  both  polynomials  P(y) 
and  P’(l/y)  under  the  form  (10)  and  effect 
the  multiplication  of  corresponding  parenthe¬ 
ses,  we  find  that,  to  within  sign,  the  pro¬ 
duct  of  parentheses  with  degree  2P  can  take 
only  3  £orms  and  not  4,  before  the  reduction 
mod  (y2  -1 )  is  effected  : 

pP  pP  pP  pP 

(1+  y£  )(i+  l/y£  )=  2  +  y  +l/y  ("-1"  form) 


1 1  +y2  )(i-i/y2f=-(i-y~  X'+i/y2  )=y2  -1/y2 


("0"  form) 

pP  pP  pP  pP 

(1  -  y  )('  -  i/y  )  =  2  -  y  -  l/y  (wfcrm) 

As  a  consequence  from  theorem  2,  the 
equivalence  number  in  Gray  code  in  a  equiva¬ 
lence  class  defines  the  signs  in  th-  expression 
(lO)  for  the  functions  in  that  class  and 
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announced  result  follows. 


Convolution  classes 


If  two  Walsh  functions  are  in  diaphonic 
equivalence  classes  with  different  values  of 
k„,  the  convolution  product  vanishes  identi¬ 
cally  :  Q. ,(x)  =  0  for  all  x. 

If  two  Walsh  functions  are  in  diaphonic 
equivalence  classes  with  the  same  index  k-, 
their  convolution  product  does  not  vanish; 
even  if  the  functions  have  not  the  same  pa¬ 
rity  and  are  absolutely  orthogonal  for  this 
reason,  (in  all  cases  :  Q^j(0)=0  if  i  ^  j). 

We  see  that  having  a  non-gero  convolu¬ 
tion  product  is  an  equivalence  relation  for 
Walsh  functions.  Equivalence  classes  for  this 
relation  are  the  union  of  two  cla33es  with 
same  kQ  and  opposite  parities. 

Finally,  then  :  there  are  k-H  convolution 
classes  in  the  group  of  the  2k  first  Walsh 
functions. 

All  these  classes  are  isomorphic  a3  a 
consequence  of  Theorem  1 . 

Having  in  mind  that  any  even  Walsh 
function  is  equal  to  the  proceeding  odd  func¬ 
tion  cyclically  shifted,  we  can  recapitulate 
following  results  : 

-  in  a  diaphonic  equivalence  class  containing 

2^  Walsh  functions  (e  from  0  to 2^-1 ) , 

there  are,  to  within  sign,  3^  different  ^ 

convolution  products  (Th.  4)  and,  then.  3 

distinct  diaphonic  characteristics  D.  .(n  ) 

r  ij'  max' 

k+1 

-  in  a  convolution  clas3  containing  2 
Walsh  functions,  and  resulting  from  the 
union  of  two  diaphonic  classes  with  same 
kg,  there  are  :  4.3*  different  convolution 
products  to  within  sign,  but  only  3 ^  diffe¬ 
rent  convolution  products  to  within  a 
cyclical  shift  (Each  product  is  repeated 

4  times  with  different  cyclical  shifts). 


interval  :  r  «  T/2^  (this  means  that 
synchronization  is  acceptable) 

2)  relative .variation  of  tne  s.  over  one  pe¬ 
riod  can  be  neglected  (this1  approximation 
is  tantamount  to  evaluating  the  main  part 
only  in  the  error). 

Denote  by  W’(N,t)  the  Walsh  functions  at 
receiving  end  : 

W'(H,t)  =  w(N,t-r). 

Received  signals  will  be  : 

1  i=2k-1  f  T 

s'fi  fl  3i  ‘  J  W(i,t).W'(j,t)  dt  = 

J  i  =  0  0 

i  i=2k-1  r 

rfi  J  w  (i,t)  W(j,t-r)  dt 


or  ;  s  . 
i=2  -1 

'<  =  ^  *««<*> 


if  P..(r)  is  the  normalized  convolution 
product  V 

Pij^=f  JQ  w(i>t)-w(j.t-r)dt  (Pij(°)=^J 

A3  a  result  of  hypothesis  1 ,  we  have  s 

dP  (0)  dP.fo) 

Pij  r  =r  5r  if  1  *  j'  and  Pii(r) =1-E- 

and  we  study  hereafter  the  absolute  values 
K  of  the  slopes  at  origin  of  convolution 
products.  These  coefficients  K  .  are  the  in¬ 
fluence  coefficients  of  synchronization  error. 
which  will  produce  on  channel  nr.i  : 

-  an  attenuation  :  Pii^=  1 

-  a  diaphony  from  j  th. channel  : 


Pij(r)  =  rlKij( 


with  r  >■  0. 


Synchronization  Error  effect 

Suppose  now  that  in  the  multiplex  fig.  1 , 
there  is  neither  line  filtering  nor  additive 
noise,  but  that  a  time  lag  r  exists  between 
the  clocks  generating  the  Walsh  carriers  in 
transmission  and  reception  ends.  Let  1  be  the 
period. 

We  suppose  also  that  : 

1 )  r  is  small  with  regard  to  an  elementary 


Slopes  at  origin  of  convolution  products 

The  complete  (and  rather  tedious)  proofs 
of  following  facts  are  exposed' in  ex tens o  in 
ref.  2  : 


Theorem  5  -  S-opes  at  origin  K, .  are  integer 
multiples  of  the  smallest  one.  3  Inside  a 


convolution  class,  they  are  odd  integer  mul¬ 
tiples  of  it. 
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(This  is  a  consequence  of  the  c .  in  theorem 
3  being  integers).  J 


Theorem  6  -  Slone  at  origin  K, .  of  an  auto¬ 
convolution  product  is  proportional  to  the  se- 
quency  of  the  function. 

K. .  =  4  s/T 

ix 

(Each  zero  crossing  in  the  function  has  a 
"contribution  2  r/T  in  the  decrease  of  the 
normalized  autoconvolution  product). 

Theorem  7  -  We  have  :  K.  .  <■'  inf  (K. .  ,K.  .) 
- L  ijv  ii'  jj 


Universal  Matrix  for  Synchronization  error 
coefficients 


A  consequence  of  preceeding  results  is 
that  we  can  construct  an  universal  symmetri¬ 
cal  matrix  with  integer  terms  ;  k. .  =K. ..T/4 
for  the  normalized  influence  coefficients  of 
synchronization  error.  All  diagonal  terms 
will  be  equal  to  the  frequency  of  the  corres¬ 
ponding  Walsh  function. 


If  we  restrict  this  matrix  to  the  first 
convolution  class,  kg  =  1  it  will  comprise 
only  odd  integers.  The  k.  .  matrix  for  a  class 
with  k  (  1  vill  be  obtained  by  multiplying 
1 

it  by  2  (by  theorem  l). 


Following  recursive  construction __gives 
the  k  matgix  of  rank  2~  ,  let  it  be  k  . , 
when  the  k  matrix  of  rank  2P  is  known1** 
(cf.  2  forpcomplete  justification). 


Let  k  be  divided  into  4  stmares 
(fig. 3).  _  Upper  left  square  13  jc.~Uppor 

rjgnt  square  is  Sk  obtained  from  bv  colum 
reversal.  Lower  loft  square  is  p  .  obtain 
ned  from ~k~  bv  line  reversal.  Lowe?  right 
square  is  ? 

^  P  W 

k  +  2r.  1  (1  being  the  unitary  matrix  with 
p  rank  2r 


1 

1 


Starting  matrix  kj  is  easily  seen  to  be  : 
for  the  two  functions  of  unit  sequency. 


*p 

ssp 

■■  1 J 

Figure  4  gives  the  k,  matrix,  allowing 
to  compute  the  synchronization  effect  for  the 
16  first  Walsh  Functions  group. 
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The  matrix 


*3 


Conclusions 


From  an  algebraic  3tudv  of  Walsh  functions 
we  have  derived  practical  formulas  to  compute 
the  effects  of  limiled  passband, noise  and  syn¬ 
chronization  errors  in  a  Walsh  carrier  multi¬ 
plex.  The  consideration  of  equivalence  classes 
le.  ds  to  the  conclusions  that  from  the  group 
of  the  2r  first  Walsh  functions  we  can  extract 
2k  carriers  such  that  a  multiplex  with  these 
carriers  shall  have  no  interchannel  diaphonv 
induced  bv  the  limited  nassband  of  the  line. 
and  k+1  carriers  such  that  a  multiplex  with 
these  carriers  shall  have  no  interchannel  dia¬ 
phonv  induced  bv  the  synchronization  error. 

These  results  are  of  practical  meaning. 

Our  initial  non  recursive  generation  al¬ 
gorithm  has  analogies  with  the  definition  pro¬ 
posed  by  LACKEY  and  MELTZER  (3)  and  justified 
ih  exten30  by  DAVIES  (4).  But  the  choice,  as  a 
basis,  of  even  (cyclically  shifted)  Rademacher 
functions  instead  of  odd  Rademacher  functions 
opens  the  way,  by  .  .orem  1 ,  to  a  synthetic 
view  of  the  spectral  properties  of  Walsh 
functions. 


P+1 


Fig.  3  Recursive  construction  of  matrix  k 
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SEQUENCY  UNION 


A  Specialist  Working  Group  of  the  IEEE  Electromagnetic  Compatibility  Group 


Since  the  beginning  of  the  Walsh  Functions  Sym¬ 
posiums  in  Washington,  D.  C.  in  1969,  there 
have  been  repeated  suggestions  that  a  scientific 
group  should  be  organized  for  those  working  on 
applications  of  Walsh  functions  and  other  com¬ 
plete  systems  of  nonsinusoidal  functions.  In 
September  1971  H.  C.  Andrews  of  the  Univer¬ 
sity  of  Southern  California,  H.F.Harmuth  of 
Catholic  University  of  America,  G.S.  Robinson 
of  Comsat  Laboratories  and  J.  L.  Walsh  of  the 
University  of  Maryland  took  the  initiative  and 
invited  all  those  who  had  helped  organize  the 
symposiums  or  had  presented  papers  to  form  a 
Founding  Committee  for  such  a  group.  The  fol¬ 
lowing  47  scientiste  became  members  of  this 
Founding  Committee  of  the  Sequency  Union: 

N.  Ahmed  (USA),  H.  C.  Andrews  (USA),  R.  Bar¬ 
rett  (England),  J.  W.  Bayless  (USA),  C.  Boess- 
wetter  (Germany),  E.Briganti  (Italy),  V.  D. 
Brown  (USA),  E.C.  Claire  (USA),  R.  B.  Critten¬ 
den  (USA),  I.  Davidson  (Canada),  A.  R.  Elliott 
(Canada),  T.H.  Frank  (USA),  J.E.  Gibbs  (Eng¬ 
land),  J.  P.  Golden  (USA),  J.  A.  Gordon  (England), 
H.F.Harmuth  (USA),  H.  A. Helm  (USA).  H.Hueb- 
ner  (Germany),  T.Ito  (Japan),  P.C.Jain  (USA). 
S.  C.  Kak  (India),  J.  Kane  (Canada),  J.D.  Lee 
(USA),  R.  Lopez  de  Zavalia  (Argentina),  P.V. 
Lopresti  (USA).  P.S.  Moharir  (India),  G.G. 
Murray  (USA).  S.S.R.  Murthy  (India),  J.  Pearl 
(USA),  K.R.  Rao  (USA).  G.R.Redinbo  (USA), 

G.S.  Robinson  (USA),  J.  H.  Rosenbloom  (USA), 

G. F.  Sandy  (USA),  H.F.Schlicke  (USA),  P.E. 
Schmid  (Switzerland),  R.O.  Schmidt  (USA),  H. 

H.  Schreiber  (USA),  K.Shibata  (Japan),  G.J. 
Simmons  (USA),  W.Steenaart  (Canada),  L.  W. 
Thomas  (USA).  H.  Ueberall  (USA),  J.  L.  Walsh 
(USA).  J.  H.  Whelchel  (USA),  P.  A.  Wintz  (USA), 
C.K.Yuen  (Australia). 

The  objectives  of  the  Sequency  Union  are  to  ad¬ 
vance  understanding  in  the  uoes  of  nonsinusoidal, 
complete,  orthogonal  sets  of  functions;  to  diffuse 
the  knowledge  of  these  uses;  and  to  assist  the 
members  in  these  activities.  This  group  should 
only  exist  until  the  use  of  nonsinusoidal  functions 
is  widely  understood.  If  and  when  nonsinusoidal 
functions  are  used  as  routinely  as  sinusoidal 


functions  are  used  now,  there  would  be  as  little 
need  for  a  group  promoting  nonsinusoidal  func¬ 
tions  as  there  is  now  for  a  group  promoting 
sinusoidal  functions. 

At  the  first  meeting  of  the  Sequency  Union  in 
December  1971,  it  was  agreed  to  seek  affiliation 
with  the  IEEE  Electromagnetic  Compatibility 
Group.  This  Group  had  supported  the  Walsh 
Functions  Symposium  in  spring  of  1971.  Fur¬ 
thermore,  the  one  problem  common  to  all 
applications  of  nonsinusoidal  functions  in  all 
fields  of  communications  is  that  of  compatibility 
with  rules,  methods  and  equipment  intended  for 
sinusoidal  functions.  Mr.  L.  W.  Thomas  negot¬ 
iated  affiliation  with  the  EMC-Group.  A  formal 
invitation  to  join  as  a  Specialist  Working  Group 
was  extended  by  Mr.  R.  M.  Showers,  Chairman 
of  the  Technical  Advisory  Committee  cf  the 
EMC-Group.  This  invitation  was  accepted  at 
the  meeting  of  the  Founding  Committee  of  the 
Sequency  Union  at  Catholic  University  on  28 
March  1972. 

It  is  hoped  that  the  IEEE  EMC-Group  will 
become  the  center  for  scientists  interested  In 
the  use  of  complete,  orthogonal  systems  of  non¬ 
sinusoidal  functions.  The  IEEE  Transactions  on 
Electromagnetic  Compatibility  are  dedicated  to 
problems  of  compatibility  and  interference. 
There  are  few  uses  of  nonsinusoidal  functions 
for  which  compatibility  and  interference  are  not 
problems,  and  this  makes  the  IEEE  Transac¬ 
tions  on  EMC  a  proper  journal  for  the  publica¬ 
tion  of  papers  on  Walsh  and  other  nonsinusoidal 
functions.  General  information  on  the  activities 
of  the  Sequency  Union  will  be  published  in  the 
Newsletter  of  the  EMC-Group,  which  is  published 
quarterly  and  sent  to  all  members  of  the  Group. 


Henning  F.  Harmut'n 
Chairman,  Sequency  Union 
Department  of  Electrical  Engineering 
The  Catholic  University  of  America 
Washington,  D.  C.  20017 


